-- Logs begin at Tue 2022-06-21 17:13:20 UTC, end at Tue 2022-06-21 18:52:54 UTC. -- Jun 21 18:18:01.373127 dv-cinder-831247-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 18:18:01.382491 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 18:18:01 2022] *** Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: nodename: dv-cinder-831247-19-iscsi Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: machine: x86_64 Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: clock source: unix Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: pcre jit disabled Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: detected number of CPU cores: 4 Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: current working directory: / Jun 21 18:18:01.384529 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: detected binary path: /usr/bin/uwsgi-core Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: your processes number limit is 47680 Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: your memory page size is 4096 bytes Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: detected max file descriptor number: 2048 Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: lock engine: pthread robust mutexes Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: thunder lock: enabled Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 18:18:01.385167 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 18:18:01.430240 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: Python main interpreter initialized at 0x5563fc0079c0 Jun 21 18:18:01.430240 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: python threads support enabled Jun 21 18:18:01.430240 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: your server socket listen backlog is limited to 100 connections Jun 21 18:18:01.430240 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: your mercy for graceful operations on workers is 90 seconds Jun 21 18:18:01.430599 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 18:18:01.430678 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: *** Operational MODE: preforking *** Jun 21 18:18:01.430904 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: *** uWSGI is running in multiple interpreter mode *** Jun 21 18:18:01.430904 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: spawned uWSGI master process (pid: 103900) Jun 21 18:18:01.431099 dv-cinder-831247-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 18:18:01.432181 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: spawned uWSGI worker 1 (pid: 103901, cores: 1) Jun 21 18:18:01.432181 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: spawned uWSGI worker 2 (pid: 103902, cores: 1) Jun 21 18:18:01.432181 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 18:18:02.100632 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:18:02.101234 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:18:03.241418 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:03.241418 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: from cryptography.utils import int_from_bytes Jun 21 18:18:03.242194 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:03.242194 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: from cryptography.utils import int_from_bytes Jun 21 18:18:03.247418 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:03.247418 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: from cryptography.utils import int_from_bytes Jun 21 18:18:03.247852 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:03.247852 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: from cryptography.utils import int_from_bytes Jun 21 18:18:05.728190 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:18:05.728925 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:18:05.729033 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:18:05.729307 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:18:05.729558 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:18:05.729938 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.730272 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.730574 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.730886 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.731207 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.731511 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.731840 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.731950 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:18:05.732303 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.732380 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:18:05.732495 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.732696 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:18:05.732801 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.733001 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.733101 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:18:05.733303 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:18:05.733401 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-19-iscsi {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.733619 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.733714 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.733924 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734024 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734285 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734391 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734539 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734634 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734836 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.734935 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735151 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735248 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735452 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735555 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735839 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.735927 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.736169 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.736357 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.736550 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.737291 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.737679 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.737876 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738013 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-19-iscsi {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738206 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738344 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738516 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738607 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738824 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.738918 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739140 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739253 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739440 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739528 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739755 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.739849 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740059 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740160 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740485 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-19-iscsi {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740603 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740808 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.740951 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.741111 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.741235 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.741418 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.741516 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.741841 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.742092 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.742285 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.742482 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.742662 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.742851 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743043 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743179 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743361 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743564 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743758 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.743947 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.744155 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.744350 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.744582 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.744786 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-19-iscsi {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.744986 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.745182 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.745459 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.745609 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.745796 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.745967 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746103 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746103 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746440 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746533 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746609 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746677 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746766 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746851 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746920 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.746994 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747067 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747134 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747199 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747277 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747350 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747429 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747530 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747718 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747813 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.747933 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748109 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748228 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748435 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748545 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748749 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.748845 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749050 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749138 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749353 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749450 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749654 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749756 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.749956 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750057 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750211 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750315 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750518 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750620 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750822 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.750910 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751121 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751209 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751434 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751539 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751695 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751782 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.751941 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.752061 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.752354 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.752509 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.752688 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.752784 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753076 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753170 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753323 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753448 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753625 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753761 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.753956 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754059 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754267 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754357 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754569 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754657 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754882 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.754979 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.755196 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.755284 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.755663 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.755812 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.755940 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756075 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756207 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756292 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756438 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756525 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756716 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.756828 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.757017 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.757184 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.757281 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.757440 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.757536 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.760923 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761083 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761193 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761286 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761369 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761462 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761544 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761681 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761681 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761843 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761913 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.761992 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762065 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762180 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762273 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762355 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762441 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762518 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762607 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762688 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762778 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762858 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.762937 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763029 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763118 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763209 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763295 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763381 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763471 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763551 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763687 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763771 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.763948 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764038 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764126 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764217 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764303 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764383 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764503 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764599 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764690 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764776 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764867 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.764947 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765034 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765127 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765207 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765293 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765372 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765452 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765531 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765622 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765703 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765782 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765869 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.765949 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766035 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766170 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766303 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766442 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766606 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766734 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.766914 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.767037 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.767221 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.767346 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.767526 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.768215 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.768495 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.768604 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.768772 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.768871 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769069 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769164 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769365 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769454 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769662 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769762 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.769957 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770053 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770253 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770351 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770583 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770713 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770882 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.770970 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771180 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771293 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771483 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771581 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771781 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.771880 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772076 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772164 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772408 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772513 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772719 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.772810 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.773024 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.773113 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.773325 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.773449 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.773628 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.773760 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.773932 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.774086 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.774239 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.774412 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.774541 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.774726 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.774843 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.775032 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.775126 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.775342 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.775430 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.775662 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.775752 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.775967 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.776057 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.776277 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.776425 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.776610 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.776713 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.776929 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777018 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:05.777242 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777344 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777564 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777653 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777874 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.777963 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778185 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778283 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778496 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778584 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778801 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.778890 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779119 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779255 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779429 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779607 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779745 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.779876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780051 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780202 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780382 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780545 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780744 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.780859 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781054 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781155 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781373 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781465 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781691 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781790 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.781999 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782088 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782303 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782399 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782607 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782703 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.782925 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.783016 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.783276 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.783409 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784127 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784229 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784537 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784632 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784767 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.784857 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785076 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785165 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785384 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785481 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785690 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785810 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.785996 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786126 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786361 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786469 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786632 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786760 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.786947 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787073 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787253 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787385 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787567 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787696 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.787873 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788018 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788177 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788348 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788504 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788686 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.788805 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789005 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789098 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789319 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789408 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789719 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.789942 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790032 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790255 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790344 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790567 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790665 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790870 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.790976 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791192 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791332 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791494 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791593 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791800 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.791888 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792106 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792196 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792441 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792550 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792732 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.792821 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793039 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793133 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793342 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793440 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793643 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793731 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.793944 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794031 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794252 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794341 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794553 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794646 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794870 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.794958 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795172 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795261 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795470 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795559 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795778 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.795866 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796087 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796220 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796473 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796575 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796718 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.796809 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797025 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797120 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797331 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797420 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797637 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797739 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.797944 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798031 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798249 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798337 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798573 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798674 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.798889 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.799466 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.799842 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.799939 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800137 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800235 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800468 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800559 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800780 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.800880 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801084 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801181 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801386 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801486 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801687 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801775 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.801987 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802077 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802294 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802398 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802592 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802690 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802895 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.802985 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803195 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803284 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803495 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803584 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803793 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.803884 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804110 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804199 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804433 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804525 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804736 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.804826 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805036 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805125 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805337 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805442 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805676 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805765 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.805980 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806069 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806293 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806411 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806733 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.806911 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807013 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807217 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807327 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807524 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807622 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807830 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.807937 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808133 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808310 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808459 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808561 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808765 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.808852 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809072 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809171 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809377 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809472 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809682 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809769 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.809984 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810072 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810288 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810375 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810609 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810710 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.810911 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811014 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811223 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811313 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811525 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811624 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811834 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.811924 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812169 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812510 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812615 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812823 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.812911 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813133 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813261 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813434 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813531 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813744 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.813831 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.814046 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.814134 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.814352 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.814450 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.815214 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.815311 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.815575 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.815724 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.815890 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816042 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816185 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816325 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816522 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816628 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816837 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.816990 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817127 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817269 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817429 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817567 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817740 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.817879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818038 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818182 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818347 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818485 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818672 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818821 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.818988 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819126 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819290 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819426 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819588 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819731 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.819896 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820035 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820202 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820340 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820539 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820688 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820825 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.820960 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821094 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821240 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821396 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821570 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821700 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821838 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.821995 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822142 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822298 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822435 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822606 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822745 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.822909 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823060 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823203 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823338 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823506 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823643 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823805 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.823951 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824086 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824221 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824408 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824557 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824734 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.824887 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825034 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825170 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825305 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825439 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825622 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825776 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.825918 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826056 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826196 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826337 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826489 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826625 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826799 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.826985 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827133 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827266 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827553 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827696 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827842 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.827980 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828129 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828266 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828442 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828597 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828737 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.828910 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829058 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829227 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829327 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829533 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829623 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829844 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.829950 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830177 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830279 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830487 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830585 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.830907 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831113 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831232 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831419 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831551 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831726 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.831863 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832030 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832175 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832334 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832575 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832676 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.832923 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833031 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833240 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833331 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833545 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833643 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833849 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.833938 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834149 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834245 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834454 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834552 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834764 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.834853 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835075 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835336 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835425 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835669 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835759 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.835983 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836080 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836292 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836460 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836630 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836719 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.836938 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837072 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837250 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837416 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837563 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837653 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837887 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.837982 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838188 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838284 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838497 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838585 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838796 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.838883 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839097 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839193 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839404 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839500 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839705 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.839801 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840006 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840272 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840373 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840621 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840719 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.840922 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841012 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841224 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841313 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841522 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841611 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841825 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.841954 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842132 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842222 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842432 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842522 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842738 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.842832 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843037 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843139 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843353 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843452 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843656 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843746 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.843953 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844051 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844252 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844342 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844586 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844689 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.844929 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845025 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845229 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845325 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845540 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845627 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.845905 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846008 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846245 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846393 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846547 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846782 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.846881 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847096 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847186 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847416 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847512 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847724 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.847820 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848022 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848154 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848326 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848488 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848658 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848756 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.848958 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849049 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849264 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849352 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849567 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849872 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.849960 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850172 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850260 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850468 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850558 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850771 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.850861 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851070 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851166 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851380 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851470 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851688 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.851815 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852042 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852138 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852288 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852447 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852615 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852717 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.852927 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853032 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853226 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853319 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853529 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853625 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853829 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.853937 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854140 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854234 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854439 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854533 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854735 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.854838 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855035 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855128 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855341 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855442 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855647 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855756 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.855946 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856038 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856248 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856341 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856583 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856676 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856889 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.856987 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857193 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857365 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857525 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857665 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857813 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.857957 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858102 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858245 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858404 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858542 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858678 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858814 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.858949 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859099 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859291 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859458 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859604 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859747 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.859890 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860035 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860189 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860325 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860481 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860573 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860703 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.860869 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.861001 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.861090 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.861301 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.861945 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.862234 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.862357 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.862746 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.862894 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863049 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863209 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863369 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863524 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863674 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863834 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.863976 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864141 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864280 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864555 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864647 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864890 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.864990 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865212 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865349 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865521 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865618 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865835 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.865930 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866140 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866237 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866447 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866534 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866752 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.866840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867062 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867174 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867367 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867466 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867663 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867752 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.867966 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868063 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868268 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868428 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868699 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868896 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.868997 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869195 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869283 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869510 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869598 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869815 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.869914 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870117 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870207 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870432 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870568 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870749 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.870848 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871067 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871173 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871366 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871455 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871670 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871767 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.871975 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872073 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872277 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872438 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872605 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872707 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.872962 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873063 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873201 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873295 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873507 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873606 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873813 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.873909 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874118 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874216 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874420 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874507 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874718 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.874816 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875024 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875128 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875327 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875418 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875626 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875724 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.875944 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876032 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876248 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876345 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876573 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.876889 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.877038 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.877760 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.877893 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878040 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878190 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878341 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878505 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878771 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.878848 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879133 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879245 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879386 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879492 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879685 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879784 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.879991 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.880094 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.880294 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.880818 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.880953 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881076 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881187 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881303 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881412 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881519 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881625 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881740 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.881905 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882031 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882213 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882329 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882522 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882640 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882824 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.882949 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883124 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883239 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883430 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883545 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883737 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.883851 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884038 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884153 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884340 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884535 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884656 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884802 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.884967 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.885648 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.885736 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.885828 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.885917 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886008 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886089 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886169 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886249 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886338 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886547 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886637 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886896 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.886990 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.887258 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.887357 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.887563 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.887653 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.887884 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888008 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888204 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888316 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888544 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888647 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888847 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.888938 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889158 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889249 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889461 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889559 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889770 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.889858 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890078 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890176 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890381 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890469 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890691 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890780 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.890993 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891085 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891311 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891402 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891628 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891743 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.891937 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.892029 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.892253 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.892351 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.892711 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.892808 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893098 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893207 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893530 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893764 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.893853 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894086 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894185 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894388 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894477 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894689 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894780 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.894997 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895095 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895303 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895459 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895621 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895760 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.895897 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896042 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896181 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896316 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896537 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896634 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896825 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.896924 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897131 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897229 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897430 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897551 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897732 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.897869 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898053 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898206 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898356 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898604 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898710 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.898930 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899019 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899241 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899331 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899567 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899657 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899864 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.899965 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900182 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900271 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900511 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900604 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900812 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.900910 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901113 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901210 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901414 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901507 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901734 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.901822 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902038 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902126 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902349 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902437 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902661 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902751 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.902973 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903071 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903275 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903371 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903579 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903666 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.903901 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904000 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904209 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904300 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904541 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904632 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904867 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.904995 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905164 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905274 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905463 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905610 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905768 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.905867 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906067 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906171 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906365 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906455 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906664 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906762 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.906974 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907062 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907270 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907361 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907569 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907867 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.907958 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.908185 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.908328 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.908601 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.908702 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.908934 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909122 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909249 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909433 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909586 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909738 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.909920 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910044 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910242 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910344 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910565 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910662 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910897 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.910987 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911208 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911306 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911516 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911606 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911829 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.911926 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912137 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912236 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912467 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912561 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912779 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.912870 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913094 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913193 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913400 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913492 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913711 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.913803 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914016 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914106 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914377 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914483 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914641 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914728 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.914951 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915040 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915259 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915348 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915697 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915871 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.915960 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.916173 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.916261 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.916542 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.916758 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.916861 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917090 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917180 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917404 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917494 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917718 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.917808 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918026 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918123 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918340 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918449 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918650 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918749 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.918958 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919055 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919267 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919490 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919588 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919818 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.919907 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920143 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920231 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920491 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920596 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920817 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.920951 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921196 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921357 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921462 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921546 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921749 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.921840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922061 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922149 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922370 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922476 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922720 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.922924 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.923014 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.923257 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.923356 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.923576 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.923669 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.924447 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.924568 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.924775 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.924970 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925093 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925286 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925408 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925615 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925727 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.925907 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926024 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926219 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926336 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926529 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926650 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926845 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.926981 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927158 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927305 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927469 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927631 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927791 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.927969 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928125 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928287 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928470 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928641 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928794 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.928959 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929079 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929276 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929391 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929634 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929909 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.929998 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930227 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930325 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930542 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930640 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930858 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.930955 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931173 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931342 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931486 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931576 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931799 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.931888 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932114 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932215 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932438 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932531 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932745 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.932834 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933053 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933143 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933359 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933446 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933664 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933762 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.933983 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934073 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934293 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934390 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934596 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934699 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.934913 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.935002 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.935219 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.935309 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.935532 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.935746 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936058 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936149 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936377 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936485 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936725 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.936825 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937047 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937136 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937359 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937449 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937664 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937763 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.937981 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938076 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938281 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938369 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938587 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938704 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.938899 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.939008 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.939209 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.939338 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.939524 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.940293 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.940434 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.940529 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.940731 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.940827 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941047 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941141 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941355 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941447 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941682 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941778 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.941978 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942076 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942304 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942518 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942611 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942877 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.942968 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943182 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943271 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943492 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943583 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943794 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.943886 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944098 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944188 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944510 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944722 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.944829 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945033 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945141 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945331 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945426 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945638 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945737 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.945941 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946052 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946244 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946350 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946544 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946642 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946855 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.946946 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947170 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947272 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947480 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947572 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947790 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.947879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948091 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948195 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948416 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948511 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948727 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.948822 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949035 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949153 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949336 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949467 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949644 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949736 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.949951 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.950041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.950702 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.950819 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.950961 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951226 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951324 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951403 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951474 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951543 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951611 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951783 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.951894 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952059 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952150 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952365 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952484 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952693 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952795 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.952998 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953088 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953316 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953415 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953623 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953722 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.953930 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954029 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954237 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954335 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954546 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954638 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954852 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.954943 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955192 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955306 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955523 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955614 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.955928 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.956195 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.956297 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.956530 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.956649 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.956838 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957076 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957178 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957415 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957508 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957734 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.957838 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958070 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958174 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958380 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958492 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958696 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.958787 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959008 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959114 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959315 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959415 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959621 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959716 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.959926 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960027 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960231 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960335 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960560 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960653 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.960873 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961045 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961188 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961279 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961492 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961582 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961795 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.961896 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962105 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962193 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962419 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962517 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962732 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.962831 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963044 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963136 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963357 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963447 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963669 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963766 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.963984 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964079 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964287 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964383 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964625 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964725 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.964931 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965030 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965258 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965380 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965590 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965684 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.965911 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966011 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966232 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966342 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966534 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966633 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966836 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.966926 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967144 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967243 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967452 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967552 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967769 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.967875 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968076 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968193 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968376 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968595 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968695 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.968985 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969211 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969310 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969537 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969634 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969854 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.969961 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970152 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970250 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970459 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970571 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970779 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.970886 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971137 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971229 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971441 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971531 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971743 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.971843 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972045 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972137 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972345 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972485 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972676 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972769 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.972980 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973079 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973280 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973370 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973579 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973670 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973881 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.973979 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974180 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974278 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974507 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974598 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974835 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.974926 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975141 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975239 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975455 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975553 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975763 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.975856 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976071 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976171 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976375 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976494 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976706 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.976834 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977020 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977121 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977329 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977421 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977632 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977726 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.977938 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978038 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978377 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978481 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978577 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978661 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978852 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.978944 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979161 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979281 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979465 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979550 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979769 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.979866 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980078 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980169 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980443 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980540 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980708 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.980799 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981030 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981131 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981344 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981445 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981663 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981765 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.981976 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982068 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982282 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982386 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982604 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982696 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.982910 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983008 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983219 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983324 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983531 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983623 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983837 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.983929 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984144 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984250 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984480 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984576 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984797 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.984889 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985120 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985219 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985432 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985530 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985736 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.985826 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.986048 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.986138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.986882 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.987061 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.987240 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.987331 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.987837 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.987980 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988150 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988326 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988505 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988678 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988826 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.988993 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989154 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989325 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989475 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989624 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989791 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.989891 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:18:05.990123 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.990439 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.990752 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.991071 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.991387 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.991702 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.992021 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.992340 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.992698 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.993027 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.993340 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.993672 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.994003 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.994356 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.994674 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.995028 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.995359 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.995677 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.995994 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.996302 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:05.996575 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:18:06.144752 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Registered counter for database nova_api Jun 21 18:18:06.151786 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Registered counter for database nova_api Jun 21 18:18:06.165314 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-814f71de-37a9-4408-acf3-960158df7bed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.171606 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.172161 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.179065 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.231747 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.context [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),770c3dab-ef8d-4f16-8479-2c2c8f1cce74(cell1) {{(pid=103901) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:18:06.235628 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:06.237752 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.context [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),770c3dab-ef8d-4f16-8479-2c2c8f1cce74(cell1) {{(pid=103902) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:18:06.237868 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:06.238651 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:06.240630 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:06.241684 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:06.242665 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Registered counter for database nova_cell0 Jun 21 18:18:06.243258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:06.244036 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:06.246010 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_concurrency.lockutils [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:06.246730 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Registered counter for database nova_cell1 Jun 21 18:18:06.247984 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Registered counter for database nova_cell0 Jun 21 18:18:06.252501 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Registered counter for database nova_cell1 Jun 21 18:18:06.255470 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-814f71de-37a9-4408-acf3-960158df7bed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.257167 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-814f71de-37a9-4408-acf3-960158df7bed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.259646 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.261472 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.263184 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.267032 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.403146 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.408124 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.413384 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO dbcounter [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Registered counter for database nova_cell0 Jun 21 18:18:06.418466 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO dbcounter [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Registered counter for database nova_cell0 Jun 21 18:18:06.422230 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_db.sqlalchemy.engines [None req-814f71de-37a9-4408-acf3-960158df7bed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.427094 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writer thread running {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.427312 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG oslo_db.sqlalchemy.engines [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:06.431866 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writer thread running {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:06.886511 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-814f71de-37a9-4408-acf3-960158df7bed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:06.893892 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:07.081873 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:07.089582 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:07.232058 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-814f71de-37a9-4408-acf3-960158df7bed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:07.238961 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: WARNING keystonemiddleware.auth_token [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:07.244267 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563fc0079c0 pid: 103901 (default app) Jun 21 18:18:07.246339 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:18:07.247519 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-814f71de-37a9-4408-acf3-960158df7bed None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Jun 21 18:18:07.247944 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Jun 21 18:18:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:18:07.431534 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:07.437530 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: WARNING keystonemiddleware.auth_token [None req-fd62489d-10a8-47f4-8c8e-3dba7d645876 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:07.443066 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563fc0079c0 pid: 103902 (default app) Jun 21 18:19:28.960550 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:28.962797 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-814f71de-37a9-4408-acf3-960158df7bed None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002734 Jun 21 18:19:28.963225 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:28.984186 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:28.985247 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell0:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:28.986905 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell1:SELECT=3 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:28.988146 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:29.455850 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-a78723a0-f42c-4acd-82d0-248ba8dd2ec0 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:29.490715 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-a78723a0-f42c-4acd-82d0-248ba8dd2ec0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.517153 Jun 21 18:19:29.491524 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jun 21 18:19:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:31.606384 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-814f71de-37a9-4408-acf3-960158df7bed None None] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:31.607382 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-814f71de-37a9-4408-acf3-960158df7bed None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 21 18:19:31.607791 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:31.669642 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-734bd780-b8c2-4c2a-ab8e-6c23a7358148 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:31.688747 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:19:31.688747 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: warnings.warn(msg) Jun 21 18:19:31.792599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-734bd780-b8c2-4c2a-ab8e-6c23a7358148 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.177886 Jun 21 18:19:31.793486 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:31.808126 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:31.809369 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:31.811093 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell1:SELECT=3 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:31.812309 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:19:32.031309 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-27ce345c-05cd-4c42-b508-d804b7988108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:32.033845 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:19:32.033845 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:19:32.209255 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-27ce345c-05cd-4c42-b508-d804b7988108 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.406760 Jun 21 18:19:32.210201 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jun 21 18:19:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:34.382189 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-734bd780-b8c2-4c2a-ab8e-6c23a7358148 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:34.383327 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-734bd780-b8c2-4c2a-ab8e-6c23a7358148 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jun 21 18:19:34.383836 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:34.496419 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-dbee1f51-83a7-4b06-bc79-eabd7d2425f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:34.515362 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:19:34.515362 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:19:34.623467 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-dbee1f51-83a7-4b06-bc79-eabd7d2425f9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.233039 Jun 21 18:19:34.623960 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:19:34.636555 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-c1144651-81f6-40c2-bac8-bb495bb13e96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:34.638158 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:19:34.638158 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: warnings.warn(msg) Jun 21 18:19:34.767508 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-c1144651-81f6-40c2-bac8-bb495bb13e96 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131428 Jun 21 18:19:34.777337 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jun 21 18:19:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:36.925121 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-dbee1f51-83a7-4b06-bc79-eabd7d2425f9 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:36.926129 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-dbee1f51-83a7-4b06-bc79-eabd7d2425f9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jun 21 18:19:36.926529 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:36.995581 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8d22f92f-971a-4bf2-9c63-557b58dbc158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:37.097988 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-8d22f92f-971a-4bf2-9c63-557b58dbc158 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165120 Jun 21 18:19:37.098729 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:37.110320 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-b5c33c42-b135-4a93-82d8-33e5edc2399b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:37.444969 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-b5c33c42-b135-4a93-82d8-33e5edc2399b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338284 Jun 21 18:19:37.445771 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jun 21 18:19:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:39.623264 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-8d22f92f-971a-4bf2-9c63-557b58dbc158 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:39.627599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-8d22f92f-971a-4bf2-9c63-557b58dbc158 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 21 18:19:39.627599 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:19:39.685511 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-75eb4352-744b-4868-976b-2fd8cc9a97ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:39.800150 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-75eb4352-744b-4868-976b-2fd8cc9a97ba admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168676 Jun 21 18:19:39.800652 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:39.813328 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-c267038e-f939-40b9-b754-3989692a5d3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:39.917576 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-c267038e-f939-40b9-b754-3989692a5d3e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108260 Jun 21 18:19:39.918165 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jun 21 18:19:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:42.049290 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-75eb4352-744b-4868-976b-2fd8cc9a97ba admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:42.050908 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-75eb4352-744b-4868-976b-2fd8cc9a97ba admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002623 Jun 21 18:19:42.051313 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:42.119434 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:42.199465 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141979 Jun 21 18:19:42.200515 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:42.213992 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-c7100cc6-aa84-497b-a9f1-9816aedd1fae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:42.329004 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-c7100cc6-aa84-497b-a9f1-9816aedd1fae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118634 Jun 21 18:19:42.330379 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Jun 21 18:19:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:44.518907 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:44.520645 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Jun 21 18:19:44.521553 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:44.593084 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-3c68463f-b579-4d61-80c7-4646430cff70 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:44.620015 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-3c68463f-b579-4d61-80c7-4646430cff70 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088315 Jun 21 18:19:44.620572 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jun 21 18:19:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:19:46.943101 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:46.944201 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-e869b791-4be0-4fe2-8ba8-7d62e1e1b5e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 21 18:19:46.944658 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:47.014141 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-1e693370-a62a-43d7-8bdb-146758506a87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:47.093470 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-1e693370-a62a-43d7-8bdb-146758506a87 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142002 Jun 21 18:19:47.095833 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:47.107107 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-a82b107e-f8b3-4f18-b67e-d06bbf5922de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:47.205485 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-a82b107e-f8b3-4f18-b67e-d06bbf5922de admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102100 Jun 21 18:19:47.206363 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jun 21 18:19:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:19:49.356821 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-1e693370-a62a-43d7-8bdb-146758506a87 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:49.357891 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-1e693370-a62a-43d7-8bdb-146758506a87 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Jun 21 18:19:49.358318 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:19:49.433869 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1b010dda-ad77-4a25-be74-e34eb9abc719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:49.533189 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1b010dda-ad77-4a25-be74-e34eb9abc719 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.167247 Jun 21 18:19:49.533948 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:19:49.549389 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-eb615b7d-7e02-404b-95a9-4e11d22c4af0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:49.697617 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-eb615b7d-7e02-404b-95a9-4e11d22c4af0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153446 Jun 21 18:19:49.698467 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jun 21 18:19:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:51.956202 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1b010dda-ad77-4a25-be74-e34eb9abc719 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:51.957434 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1b010dda-ad77-4a25-be74-e34eb9abc719 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Jun 21 18:19:51.958125 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:52.033825 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0966492a-e29f-48a2-8923-3f8fb37f7014 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:52.115181 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0966492a-e29f-48a2-8923-3f8fb37f7014 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.148530 Jun 21 18:19:52.115752 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:52.128867 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-81255ae7-1245-4346-993c-4673fd529da7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:52.203545 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-81255ae7-1245-4346-993c-4673fd529da7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078809 Jun 21 18:19:52.204175 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jun 21 18:19:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:54.339123 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0966492a-e29f-48a2-8923-3f8fb37f7014 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:54.340124 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0966492a-e29f-48a2-8923-3f8fb37f7014 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 21 18:19:54.340568 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:54.407201 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-67219010-a92a-4e43-aee4-9d72e53941cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:54.511069 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-67219010-a92a-4e43-aee4-9d72e53941cf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162657 Jun 21 18:19:54.511625 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:19:54.524305 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-12006d61-1ff8-4a97-bb27-7a1414af6ad1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:54.614884 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-12006d61-1ff8-4a97-bb27-7a1414af6ad1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093973 Jun 21 18:19:54.615573 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jun 21 18:19:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:19:56.744272 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-67219010-a92a-4e43-aee4-9d72e53941cf admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:19:56.745985 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-67219010-a92a-4e43-aee4-9d72e53941cf admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Jun 21 18:19:56.746400 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:19:56.824904 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:56.928307 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.174516 Jun 21 18:19:56.929191 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Jun 21 18:19:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:19:56.941845 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-d21deb1a-538d-49d9-99e0-b8771a8f016c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:19:57.608519 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-d21deb1a-538d-49d9-99e0-b8771a8f016c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.670637 Jun 21 18:19:57.609511 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Jun 21 18:19:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:22.462262 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:22.464114 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002469 Jun 21 18:20:22.464881 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:22.476916 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:22.536107 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-622d6e52-ee4d-4e1d-aa67-d319ca32a946 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:22.555671 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-622d6e52-ee4d-4e1d-aa67-d319ca32a946 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083542 Jun 21 18:20:22.556295 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jun 21 18:20:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:20:23.607002 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:23.608015 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-29bdf00c-1f1e-414f-827d-ddf761e59b24 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 21 18:20:23.608461 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:23.812488 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e5c85330-304e-43e5-84c4-8b546ad55926 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:23.822380 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-e5c85330-304e-43e5-84c4-8b546ad55926 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e5c85330-304e-43e5-84c4-8b546ad55926 admin admin] Request method failure captured: Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept: application/json Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Connection: keep-alive Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Content-Length: 0 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Host: 10.222.0.23 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABisgvnnUO_CfGvDIH2cOdFCM3qTrOJWWIWPCLubCP09mrAV23i7Gw--dZubTv_ONb0zNeU7l70L3m8FvOokgdOiJxitVr3-Thsp8mCV_v7RrJrebH3UGK-psYvQAR3J5J2X7sC2LS1nNDXGtFTsDtzIBTDeEZO6emABGIW1KfHwv0L7D8 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Id: None Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Name: None Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Name: admin Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader Jun 21 18:20:23.825666 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant: admin Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User: admin Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Name: admin Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: method: > Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: exception: Flavor 42 could not be found. Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: action_args: {'id': '42'} Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:23.828885 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:23.830879 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.833840 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e5c85330-304e-43e5-84c4-8b546ad55926 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:23.836246 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-e5c85330-304e-43e5-84c4-8b546ad55926 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078831 Jun 21 18:20:23.836246 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jun 21 18:20:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:23.837679 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-4cd26a3d-139d-480a-96cb-f8ae0633e003 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:23.848825 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:23.860043 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-4cd26a3d-139d-480a-96cb-f8ae0633e003 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025775 Jun 21 18:20:23.862078 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:20:23.874899 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-54a75859-b56d-4c6c-8dab-0615c064f205 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:23.899919 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-54a75859-b56d-4c6c-8dab-0615c064f205 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028634 Jun 21 18:20:23.900544 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:20:23.915017 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-40d979a1-15cb-4234-8750-a55225020a75 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:23.926043 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-40d979a1-15cb-4234-8750-a55225020a75 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-40d979a1-15cb-4234-8750-a55225020a75 admin admin] Request method failure captured: Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept: application/json Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Connection: keep-alive Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Content-Length: 0 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Host: 10.222.0.23 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABisgvnnUO_CfGvDIH2cOdFCM3qTrOJWWIWPCLubCP09mrAV23i7Gw--dZubTv_ONb0zNeU7l70L3m8FvOokgdOiJxitVr3-Thsp8mCV_v7RrJrebH3UGK-psYvQAR3J5J2X7sC2LS1nNDXGtFTsDtzIBTDeEZO6emABGIW1KfHwv0L7D8 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Id: None Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Name: None Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Name: admin Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader Jun 21 18:20:23.932073 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant: admin Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User: admin Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Name: admin Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: method: > Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: exception: Flavor 42 could not be found. Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: action_args: {'id': '42'} Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:23.939138 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:23.941148 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:23.943041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-40d979a1-15cb-4234-8750-a55225020a75 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:23.944873 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-40d979a1-15cb-4234-8750-a55225020a75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.027092 Jun 21 18:20:23.944873 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jun 21 18:20:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:24.850101 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-54a75859-b56d-4c6c-8dab-0615c064f205 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:24.851120 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-54a75859-b56d-4c6c-8dab-0615c064f205 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 21 18:20:24.851615 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:25.065380 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0091faf8-2029-42b1-b24f-87d8405c738c admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:25.071662 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-0091faf8-2029-42b1-b24f-87d8405c738c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0091faf8-2029-42b1-b24f-87d8405c738c admin admin] Request method failure captured: Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept: application/json Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Connection: keep-alive Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Content-Length: 0 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Host: 10.222.0.23 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABisgvorMl1lLgMTctepOz1nuA-tvmGq_0apD3Wg6aSsmc5rN4IE7lngwiJ-TEl3xZizRbucWKasPehlb7widIfac2paQwMZtgX6ntykf0iZV9sEU4ITXnLGalRxUSfEPmj1dvuDNNR0jJo0U80-68LMYQIWPBmVOok2yo4Q4CumcRwKL4 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Id: None Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Name: None Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Name: admin Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader Jun 21 18:20:25.073351 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant: admin Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User: admin Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Name: admin Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: method: > Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: exception: Flavor 84 could not be found. Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: action_args: {'id': '84'} Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:25.075803 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:25.077440 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.079862 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-0091faf8-2029-42b1-b24f-87d8405c738c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:25.081928 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-0091faf8-2029-42b1-b24f-87d8405c738c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.079326 Jun 21 18:20:25.081928 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jun 21 18:20:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:25.088429 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-20d7417a-7123-466e-a997-f41c146c36bf admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:25.105171 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-20d7417a-7123-466e-a997-f41c146c36bf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023593 Jun 21 18:20:25.105736 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:20:25.116671 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-d612e2b4-abf5-4042-a9f2-9790ec008f1b admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:25.132865 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-d612e2b4-abf5-4042-a9f2-9790ec008f1b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020034 Jun 21 18:20:25.133418 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:20:25.143485 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-11f948e0-b7fd-4cf8-a86d-7411d6777d5b admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:25.149096 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-11f948e0-b7fd-4cf8-a86d-7411d6777d5b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-11f948e0-b7fd-4cf8-a86d-7411d6777d5b admin admin] Request method failure captured: Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept: application/json Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Connection: keep-alive Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Content-Length: 0 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Host: 10.222.0.23 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABisgvorMl1lLgMTctepOz1nuA-tvmGq_0apD3Wg6aSsmc5rN4IE7lngwiJ-TEl3xZizRbucWKasPehlb7widIfac2paQwMZtgX6ntykf0iZV9sEU4ITXnLGalRxUSfEPmj1dvuDNNR0jJo0U80-68LMYQIWPBmVOok2yo4Q4CumcRwKL4 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Id: None Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Name: None Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Name: admin Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader Jun 21 18:20:25.150630 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant: admin Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User: admin Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Name: admin Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: method: > Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: exception: Flavor 84 could not be found. Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: action_args: {'id': '84'} Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:25.152258 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:25.153384 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:25.154827 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-11f948e0-b7fd-4cf8-a86d-7411d6777d5b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:25.156089 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-11f948e0-b7fd-4cf8-a86d-7411d6777d5b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012612 Jun 21 18:20:25.156089 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Jun 21 18:20:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:26.040200 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-d612e2b4-abf5-4042-a9f2-9790ec008f1b admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:26.041264 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-d612e2b4-abf5-4042-a9f2-9790ec008f1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 21 18:20:26.041673 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:26.243835 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e9c56fdf-d4c5-49a6-a6b0-e8ed87299022 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:26.252580 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.wsgi [None req-e9c56fdf-d4c5-49a6-a6b0-e8ed87299022 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e9c56fdf-d4c5-49a6-a6b0-e8ed87299022 admin admin] Request method failure captured: Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept: application/json Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Accept-Encoding: gzip, deflate Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Connection: keep-alive Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Content-Length: 0 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Host: 10.222.0.23 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Openstack-System-Scope: None Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: User-Agent: python-novaclient Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Auth-Token: gAAAAABisgvqa_OtW-iJ_FzTtmv1VP4U66mYQUDvAa5WOrRIKjCoMkNSt0zuXR-bprhRj9_wEeIxPsdfoVhOgWvlOwg0TSJ7gGzjkHbcbcsntl_iWvhtVk-WRo9JFc-UpyvsMLHZ_5R0HfnWLj8R5o-i3Hh-pr5TEBfCYxyQv8208qd4UD9eGvM Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Id: None Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Domain-Name: None Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Identity-Status: Confirmed Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Is-Admin-Project: True Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Id: default Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Domain-Name: Default Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Project-Name: admin Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Role: admin,member,reader Jun 21 18:20:26.254366 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Roles: admin,member,reader Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant: admin Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-Tenant-Name: admin Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User: admin Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Id: default Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Domain-Name: Default Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: X-User-Name: admin Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: method: > Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: exception: Flavor 451 could not be found. Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: action_args: {'id': '451'} Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:26.256876 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:26.258489 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.260528 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-e9c56fdf-d4c5-49a6-a6b0-e8ed87299022 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:26.262372 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-e9c56fdf-d4c5-49a6-a6b0-e8ed87299022 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072868 Jun 21 18:20:26.262372 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:20:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:26.268872 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a03b7b31-c2d6-4ead-baf6-c70b8426bd64 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:26.283462 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a03b7b31-c2d6-4ead-baf6-c70b8426bd64 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018619 Jun 21 18:20:26.284041 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:20:26.294143 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:26.310376 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019751 Jun 21 18:20:26.311087 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Jun 21 18:20:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:20:26.322108 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-288b05ee-4c14-4e74-9d0a-8a3462fe15b0 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:26.327999 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.wsgi [None req-288b05ee-4c14-4e74-9d0a-8a3462fe15b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-288b05ee-4c14-4e74-9d0a-8a3462fe15b0 admin admin] Request method failure captured: Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept: application/json Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Accept-Encoding: gzip, deflate Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Connection: keep-alive Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Content-Length: 0 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Host: 10.222.0.23 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-Api-Version: compute 2.90 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Openstack-System-Scope: None Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: User-Agent: python-novaclient Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Auth-Token: gAAAAABisgvqa_OtW-iJ_FzTtmv1VP4U66mYQUDvAa5WOrRIKjCoMkNSt0zuXR-bprhRj9_wEeIxPsdfoVhOgWvlOwg0TSJ7gGzjkHbcbcsntl_iWvhtVk-WRo9JFc-UpyvsMLHZ_5R0HfnWLj8R5o-i3Hh-pr5TEBfCYxyQv8208qd4UD9eGvM Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Id: None Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Domain-Name: None Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Identity-Status: Confirmed Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Is-Admin-Project: True Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Id: default Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Domain-Name: Default Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Project-Name: admin Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Role: admin,member,reader Jun 21 18:20:26.329635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Roles: admin,member,reader Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cecad7a8a62644cabfc30fc28ce80d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant: admin Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Id: cecad7a8a62644cabfc30fc28ce80d90 Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-Tenant-Name: admin Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User: admin Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Id: default Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Domain-Name: Default Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Id: 0c89ac265bd34c75a692d91d672fad59 Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: X-User-Name: admin Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: method: > Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: exception: Flavor 451 could not be found. Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: action_args: {'id': '451'} Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:20:26.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:26.332289 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: ERROR nova.api.openstack.wsgi Jun 21 18:20:26.333415 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-288b05ee-4c14-4e74-9d0a-8a3462fe15b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:20:26.334458 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-288b05ee-4c14-4e74-9d0a-8a3462fe15b0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012643 Jun 21 18:20:26.334458 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:20:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:20:27.233442 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:27.234586 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jun 21 18:20:27.235226 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:20:27.442581 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-35d61020-a8e7-4c98-80b8-594eda9fbfcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:27.526745 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-35d61020-a8e7-4c98-80b8-594eda9fbfcc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.147783 Jun 21 18:20:27.527313 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jun 21 18:20:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:20:28.423386 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:28.424685 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Jun 21 18:20:28.425126 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:28.632854 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-e03f6d0c-2e80-4919-b4c5-5efd4fda1649 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:28.719592 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-e03f6d0c-2e80-4919-b4c5-5efd4fda1649 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.146504 Jun 21 18:20:28.720703 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jun 21 18:20:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:29.686332 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:29.687339 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 21 18:20:29.698185 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:29.899888 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-4908d963-96d6-4332-90f4-e541fd8f9ca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:29.989867 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-4908d963-96d6-4332-90f4-e541fd8f9ca5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.157960 Jun 21 18:20:29.990687 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jun 21 18:20:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:30.840810 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:30.841869 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 21 18:20:30.842272 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:31.056558 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-3df0bde1-6298-42ed-a9ce-c97f3d341885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:31.153738 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-3df0bde1-6298-42ed-a9ce-c97f3d341885 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.157633 Jun 21 18:20:31.154374 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Jun 21 18:20:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:31.994581 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:31.995587 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 21 18:20:31.995990 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:32.198635 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-8306a36b-44e7-4afc-8cb8-d38804215090 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:32.219113 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-8306a36b-44e7-4afc-8cb8-d38804215090 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077963 Jun 21 18:20:32.219753 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Jun 21 18:20:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:21.193306 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.194374 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-1a576645-5bc1-494a-8025-0d9f6964cd6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 21 18:21:21.194776 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:21.206011 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:21:21.257386 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-6a929785-7575-4182-888d-fd17a422fde0 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.276115 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-6a929785-7575-4182-888d-fd17a422fde0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075217 Jun 21 18:21:21.276690 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:21.300407 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-840de496-739f-4825-afa8-b0977918d5d9 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.303877 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG dbcounter [-] [103902] Writing DB stats nova_api:SELECT=14 {{(pid=103902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:21:21.308952 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-840de496-739f-4825-afa8-b0977918d5d9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012942 Jun 21 18:21:21.309501 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:21:21.321902 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-52a6b762-ee6d-4ab6-b31d-7eb973ce680d admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.329994 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-52a6b762-ee6d-4ab6-b31d-7eb973ce680d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Jun 21 18:21:21.330538 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:21:21.342673 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.351024 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012245 Jun 21 18:21:21.351573 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:21:21.364091 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a963593f-033f-469b-9314-e9786655c540 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:21.372346 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a963593f-033f-469b-9314-e9786655c540 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011999 Jun 21 18:21:21.372940 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Jun 21 18:21:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:24:57.639493 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:24:57.640663 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 21 18:24:57.641068 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:24:57.785028 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=6 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:24:57.901569 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:24:57.902798 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:24:57.902798 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:24:57.904348 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:24:57.904348 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:24:57.905638 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:24:57.906066 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:24:57.941133 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-a8c0d6fc-554e-4402-9c4b-16fe91a050bf admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.157548 Jun 21 18:24:57.941702 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:24:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:24:58.783443 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:24:58.784495 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 21 18:24:58.784893 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:24:58.981663 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:24:58.982832 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:24:58.982832 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:24:58.984529 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:24:58.984968 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:24:58.985838 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:24:58.986265 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:24:59.006964 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-868bde3b-df2f-497e-bb60-285f7c1d7ea4 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081310 Jun 21 18:24:59.007495 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:24:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:25:10.268141 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:25:10.269178 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jun 21 18:25:10.269583 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:25:10.414436 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell0:SELECT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:25:10.415170 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_cell1:SELECT=4 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:25:10.415781 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG dbcounter [-] [103901] Writing DB stats nova_api:SELECT=8 {{(pid=103901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:25:10.467077 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:25:10.468890 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:25:10.468890 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:25:10.470236 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:25:10.470685 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:25:10.471522 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:25:10.471958 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:25:10.499024 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-d7f65d0e-1b6e-4b97-8148-17f7c168cea4 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088776 Jun 21 18:25:10.500117 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:25:10 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:25:11.341798 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: DEBUG nova.api.openstack.wsgi [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] Calling method '>' {{(pid=103902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:25:11.342819 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: INFO nova.api.openstack.requestlog [None req-2fb6aff0-a1e2-473d-8c3a-b02924426465 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 21 18:25:11.343779 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: [pid: 103902|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Jun 21 18:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:25:11.536560 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG nova.api.openstack.wsgi [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] Calling method '>' {{(pid=103901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:25:11.537763 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:25:11.537763 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: warnings.warn(msg) Jun 21 18:25:11.538971 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:25:11.539413 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:25:11.540206 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:25:11.540665 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: DEBUG oslo_concurrency.lockutils [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:25:11.562060 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: INFO nova.api.openstack.requestlog [None req-3d54b7b1-aba0-458f-a38a-12f6a5492a8e admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079635 Jun 21 18:25:11.562676 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: [pid: 103901|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Jun 21 18:25:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:26:09.132771 dv-cinder-831247-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 18:26:09.133312 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: Tue Jun 21 18:26:09 2022 - graceful shutdown triggered... Jun 21 18:26:09.133741 dv-cinder-831247-19-iscsi devstack@n-api.service[103901]: Gracefully killing worker 1 (pid: 103901)... Jun 21 18:26:09.134151 dv-cinder-831247-19-iscsi devstack@n-api.service[103902]: Gracefully killing worker 2 (pid: 103902)... Jun 21 18:26:10.134642 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: worker 1 buried after 1 seconds Jun 21 18:26:10.134642 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: worker 2 buried after 1 seconds Jun 21 18:26:10.134642 dv-cinder-831247-19-iscsi devstack@n-api.service[103900]: goodbye to uWSGI. Jun 21 18:26:10.136298 dv-cinder-831247-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 18:26:10.136886 dv-cinder-831247-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 18:26:10.139676 dv-cinder-831247-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 18:26:10.148817 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 18:26:10 2022] *** Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: nodename: dv-cinder-831247-19-iscsi Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: machine: x86_64 Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: clock source: unix Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: pcre jit disabled Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: detected number of CPU cores: 4 Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: current working directory: / Jun 21 18:26:10.151210 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: detected binary path: /usr/bin/uwsgi-core Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: your processes number limit is 47680 Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: your memory page size is 4096 bytes Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: detected max file descriptor number: 2048 Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: lock engine: pthread robust mutexes Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: thunder lock: enabled Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 18:26:10.151878 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 18:26:10.197744 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: Python main interpreter initialized at 0x558f3c1429c0 Jun 21 18:26:10.197744 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: python threads support enabled Jun 21 18:26:10.197744 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: your server socket listen backlog is limited to 100 connections Jun 21 18:26:10.197744 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: your mercy for graceful operations on workers is 90 seconds Jun 21 18:26:10.198183 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 18:26:10.198183 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: *** Operational MODE: preforking *** Jun 21 18:26:10.202003 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: *** uWSGI is running in multiple interpreter mode *** Jun 21 18:26:10.202003 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: spawned uWSGI master process (pid: 118455) Jun 21 18:26:10.202003 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: spawned uWSGI worker 1 (pid: 118472, cores: 1) Jun 21 18:26:10.202003 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: spawned uWSGI worker 2 (pid: 118474, cores: 1) Jun 21 18:26:10.202003 dv-cinder-831247-19-iscsi devstack@n-api.service[118455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 18:26:10.198670 dv-cinder-831247-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 18:26:10.861591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:26:10.891478 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:26:12.073237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:26:12.073237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: from cryptography.utils import int_from_bytes Jun 21 18:26:12.073869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:26:12.073869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: from cryptography.utils import int_from_bytes Jun 21 18:26:12.111770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:26:12.111770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: from cryptography.utils import int_from_bytes Jun 21 18:26:12.112353 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:26:12.112353 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: from cryptography.utils import int_from_bytes Jun 21 18:26:14.523414 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:26:14.524042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:26:14.524219 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:26:14.524653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:26:14.525014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:26:14.525595 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.526005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.526338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.527473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.527832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.528149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.528505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.528837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.529175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.529451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.529769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.530099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-19-iscsi {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.530429 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.530740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.531251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.531586 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.531895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.532228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.532581 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.533102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.533794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.534274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.534601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.534949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.535273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.535583 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.535925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.536222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.536582 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.536898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.537352 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-19-iscsi {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.537671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.537987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.538309 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.538734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.539050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.539362 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.539685 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.540107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.540510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.540852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.541179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.541503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.541825 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.542130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.542437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.542754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.543079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.543383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.543695 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.543943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.544252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.544603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.544931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.545257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.545510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.545765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.546086 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.546406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.546714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.547023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.547331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.547636 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.547948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.548249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.548585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.548890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.549212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.549533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.549858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.550167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.550486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.550898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.551163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.551475 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.551822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.552145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.552523 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.552827 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.553152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.553460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.553770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.554081 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.554400 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.554736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.555042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.555293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.556489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.556489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.556776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.557089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.557395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.557703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.558005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.558312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.558619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.558928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.559236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.559544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.559862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.560158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.560720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.561087 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.566949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.567623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.568617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.569034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.569034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.569471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.569779 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.570134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.570455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.570768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.571082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.571981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.572444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.573183 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.573584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.574058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.574420 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.574748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.575086 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.575422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.575745 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.576062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.576461 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.576846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.577195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.577524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.577892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.578272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.578597 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.578952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.579317 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.579598 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:26:14.580036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.580124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:26:14.580240 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.580346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.580484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:26:14.580740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.580847 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:26:14.581025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:26:14.581135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.581395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.581497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.581711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.581812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.582054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.582176 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.582384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.582491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.582707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.582801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.583021 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.583121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.583421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.583590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.583693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.583793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.583962 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.584070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.584251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.584347 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.584601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.584712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.584933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-19-iscsi {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.585032 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.585246 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.585367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.585568 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.585727 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.585882 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.586045 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.586199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.586372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.586512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.586684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.587015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.587156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.587248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.587493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.587588 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.587813 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.588080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.588200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.588424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.588524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.588741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.588838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.589058 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.589167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.589786 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.589889 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.589979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.590073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.590166 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.590254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.590348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.590450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.590545 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.590633 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.590846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.591317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.591437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.591591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.591724 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.591855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-19-iscsi {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.592000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.592122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.592279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.592643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.592823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.592964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.593105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.593254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.593395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.593537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.593701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.593834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.593967 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.594109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.594250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.594395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.594537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.594671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.594812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.594962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.595264 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.595401 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.595535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.595677 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.595810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.595950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.596230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.596365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.596537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.596681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.596875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.596966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.597061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.597061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.597232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.597359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.597501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.597673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.597819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.597988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.598083 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.598302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.598407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.598630 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.598753 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.598948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.599051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.599268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.599383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.599564 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.599718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.599811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.599929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.600132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.600237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.600486 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.600616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.600803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.600904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.601119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.601235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.601434 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.601559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.601751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.601854 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.602062 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.602169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.602375 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.602554 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.602730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.602843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.603040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.603166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.603431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.603533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.603781 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.603886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.604115 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.604452 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.604876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.604996 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.605376 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.605636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.605957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.606311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.606640 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.606960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.607291 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.607401 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.607693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.607804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.607965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.609139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.609309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.609445 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.609561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.609674 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.609802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.609917 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.610038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.610159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.610283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.610283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.610515 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.610620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.610715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.610803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.610896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.610997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.611092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.611187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.611281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.611368 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.611503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.611610 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.611834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.611938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.612155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.612249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.612496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.612675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.612900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.613086 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.613262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.613442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.613543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.613754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.613861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.614066 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.614175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.614377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.614477 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.614686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.614784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.615013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.615119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.615348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.615460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.615664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.615772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.615978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.616074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.616291 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.616466 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.616633 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.616771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.617008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.617127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.617351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.617494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.617675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.617772 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.618007 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.618628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.618891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.618996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.619208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.619305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.619532 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.619643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.619848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.619943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.620163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.620272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.620519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.620679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.620817 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.620921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.621132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.621238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.621456 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.621551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.621793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.621946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.622108 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.622569 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.622725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.622914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.623053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.623217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.623321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.623530 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.623687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.623844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.623947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.624157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.624252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.624501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.624599 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.624813 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.624908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.625140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.625315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.625462 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.625573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.625780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.625893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.626094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.626204 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.626423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.626569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.626724 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.626818 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:26:14.627040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627676 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627772 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.627995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628332 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628516 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.628974 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629560 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.629875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630021 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630319 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.630929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.631975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.632152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.632320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.632579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.632749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.632905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.633197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.633364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.633529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.633738 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.634659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.634955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635436 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.635888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.636043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.636191 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.636345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.636619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.636858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.637930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.638940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.639082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.639377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.639692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.640008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.640342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.640663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.640982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.641302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.641893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.642230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.642551 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.642873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.643238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.643518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.643853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.644186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.644620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.644859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645173 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645303 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645607 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.645954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.646109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.646305 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.646435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.646653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.646780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.647010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.647325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.647610 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.647748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.647955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648233 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648847 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.648995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.649138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.649440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.649579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.649925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.650113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.650344 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.650572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.650715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.650985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.651136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.651283 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.651657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.651855 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.652905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.653193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.653349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.653551 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.653782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.653916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.654167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.654300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.654478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.654753 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.654914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.655146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.655391 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.655704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.655871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.656022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.656422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.656578 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.656712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.656899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.657041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.657274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.657652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.657807 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.657948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.658123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.658265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.658529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.658685 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.658826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.659053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.659188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.659395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.659545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.659710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660163 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660329 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660567 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.660983 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.661210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.661354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.661566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.661717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.661903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.662123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.662265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.662511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.662763 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.662912 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.663119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.663253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.663447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.663765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.663909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.664074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.664297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.664467 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.664711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.664858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.665122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.665401 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.665661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.665802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666594 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666728 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.666957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.667127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.667269 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.667562 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.667815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.667965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.668172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.668342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.668513 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.668786 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.668934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.669114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.669304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.669441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.669721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.669862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.670049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.670296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.670432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.670660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.670881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.671979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.672287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.672453 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.672623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.672926 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.673061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.673281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.673468 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.673611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.673859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.674078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.674244 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.674473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.674615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.674793 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675453 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.675946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.676089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.676424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.676579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.676743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.676952 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.677094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.677435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.677586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.677728 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678646 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.678913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.679062 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.679224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.679536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.679670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.679849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.680092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.680227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.680498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.681186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.681584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.681758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.681894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.682084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.682397 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.682541 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.682711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683154 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.683957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.684177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.684319 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.684577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.684733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.684874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.685265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.685420 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.685562 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.685696 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.685937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.686117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.686268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.686556 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.686701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.686866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.687111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.687261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.687559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.687700 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.687834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.688121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.688270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.688450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.688755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.688892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.689141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.689277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.689509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.689654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.689828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690751 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.690984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.691120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.691377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.691511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.691723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.691906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.692045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.692303 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.692494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.692635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693371 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693515 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.693998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.694155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.694416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.694561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.694731 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.694974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.695127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.695893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.696040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.696197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.696969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697319 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697472 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697472 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697814 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.697956 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.698111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.698326 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.698326 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.698579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.698762 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.699073 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.699207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.699402 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.699594 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.699738 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.700088 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.700232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.700367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.700550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.700798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701012 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701147 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701814 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.701960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.702102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.702372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.702510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.702690 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.702967 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.703103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.703304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.703495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.703641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.703932 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.704246 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.704588 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.704907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.705221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.705363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.705627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.705786 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.705930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.706142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.706283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.706453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.706751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.706897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.707086 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.707256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.707399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.707709 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.707943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.708078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.708208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.708360 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.708660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.709075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.709222 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.709394 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.709591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.709727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710698 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.710967 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.711111 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.711308 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.711474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.711610 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.711983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.712179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.712326 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.712488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.712681 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.712904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.713043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.713274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.713501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.713645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.713886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.714021 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.714279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.714514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.714739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.714873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715803 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.715969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.716114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.716321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.716518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.717750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.717750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.718152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.718429 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.718571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.718785 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.719031 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.719352 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.719668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.720026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.720346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.720558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.720705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.720993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.721130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.721349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.721515 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.721690 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.721981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.722223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.722367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.722500 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.722632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.722955 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.723090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.723275 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.723600 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.723749 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.723922 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.724488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.724700 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.725019 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.725341 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.725664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.725992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.726715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.726904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.727223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.728292 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.728681 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.729306 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.729306 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.729626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.729767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.730016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.730486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.730668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.731379 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.731379 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.731668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.732147 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.732442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.732607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.732742 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.732875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.733015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.733381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.733544 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.733678 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.733858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.734992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.735165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.735343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.735484 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.735785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.735922 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.736165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.736307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.736519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.736744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.736893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.737063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.737302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.737659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.737800 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.737943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738644 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738781 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.738964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.739183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.739558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.739699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.739823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.740004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.740141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.740345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.740714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.742917 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.743105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.743923 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.744065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.744335 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.744580 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.744580 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745301 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.745722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.746722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.746864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.746864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.746864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.747493 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.747637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.747778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.747981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.747981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.748233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.748373 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.748543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.748780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.748916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.749082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.749234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.749389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.749389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.749742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.752504 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.752758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.752921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.752921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.754342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.754485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.754485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.754841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.755931 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.756927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.757068 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.757201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.757367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.757367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.757367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.758322 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.758471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.758613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.758846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.758846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.759496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.759858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760970 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.760970 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.761479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.761624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.761772 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.761906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.761906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.762155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.762578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.762746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.762986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.762986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763390 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763390 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763662 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.763794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764176 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764666 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.764937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.765373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.765546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.765694 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.765828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.765961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.766165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.766318 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767419 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.767898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.768052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.768181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.768296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.768440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.768440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.771900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.772058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.772058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.772372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.772789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773731 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.773930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774434 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.774997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.778975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.779729 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.779893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.780098 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.780296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.780508 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.780660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.780806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.781160 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.781335 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.781557 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.781711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.781862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782202 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782353 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782650 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.782929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783081 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.783951 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784024 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784430 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784430 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784588 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784918 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.784992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785086 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785330 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.785751 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787147 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787314 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787481 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787628 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787709 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.787872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788098 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788191 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788409 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.788974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789621 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789694 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.789791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.792894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.793408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794290 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794391 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794478 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.794634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795144 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795303 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795391 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.795920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.796346 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.800823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801169 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.801936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802012 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802526 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802692 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802847 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.802933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803513 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803596 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803680 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803756 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803829 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803902 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.803976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804652 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.804919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805522 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805658 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.805742 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.806335 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.806675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.806861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.806941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807111 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807111 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807257 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807339 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807419 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807727 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807888 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.807961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.808034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.808115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.808215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.808300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.808374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809056 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809135 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809308 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809775 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.809929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810724 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810805 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.810960 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.811941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.812287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.812538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.812784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.813223 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.813574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.813786 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.814103 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.814426 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.814744 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.815062 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.815396 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.815714 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.816032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.816354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.816839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.817088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.817318 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.817648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.817959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.818316 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.818957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.818957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.819286 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.819598 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.819933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.820252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.821811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.821811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.821811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.821811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.822154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.822237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.822673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.822907 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.823291 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.823623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.823947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.824263 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.824639 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.824979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.825298 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.829921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.830321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.830448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.830810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.831129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.831476 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.831811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.832147 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.832891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.832891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.833184 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.833509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.833839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.834170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.834496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.834824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.835176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.835512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.835828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.836154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.836506 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.837196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.837530 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.837875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.838202 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.838525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.838848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.839174 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.839503 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.839856 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.840177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.840549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.840877 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.841219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.841557 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.841899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.842249 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.842582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.842911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.843242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.843573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.843942 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.844269 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.844616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.844946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.845274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.845602 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.845929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.846253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.846587 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.847245 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.847451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.847777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.848107 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.848477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.848816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.849170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.849517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.849833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.850158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.850484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.851978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.851978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.851978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.852248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.853153 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.853707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.854231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.854567 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.854890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.855211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.855536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.855863 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.856180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.856791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.862928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.863993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.864153 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.864503 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.864820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.865140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.865454 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.865777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.866102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.866418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.866737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.867050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.867372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.867686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.868004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.869200 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.869766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.870247 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.870636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.870957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.871302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.871621 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.871940 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.872642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.872892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.873230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.873556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.873881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.874278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.874608 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.875185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.875509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.875845 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.876017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Registered counter for database nova_api Jun 21 18:26:14.876197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.876569 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.877063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.877390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.877714 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.878052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.878378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.878704 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.879027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.879531 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.879858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.880182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.880547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.880942 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.881607 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.881607 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.882143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.882474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.882797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.883287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.883982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.884644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.884985 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.885321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.885654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.885983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.886310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.886638 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.886962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.887606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.887606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.887936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.888255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.888827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.889155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.889487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.889821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.890141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.890476 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.890810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.891132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.891463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.891785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.892125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.892507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.892851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.893188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.893502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.893812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.894126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.894449 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.894789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.895095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.895411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.895720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.896040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.896362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.896708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.897022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.897338 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.897655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.897965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.898296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.898576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.898908 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.899221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.899604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.899924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.900190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:14.900307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.900719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.901043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.901361 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.901690 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.902025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.902370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.902713 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.903031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.903357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.903689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.904007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.904340 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.904706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.905035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.905356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.905699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.906018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.906344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.906666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.906988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.907238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:14.907336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.907616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.907956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.908292 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.908632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.908970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.909299 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.909630 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.909957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.910277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.910674 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.910969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.911287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.911614 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.911926 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.912248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.912596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.912919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.913254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.913591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.913909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.914244 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.914580 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.915671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.916050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.916381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.916749 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.917076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.917400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.917715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:26:14.917969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:26:14.966197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.context [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),770c3dab-ef8d-4f16-8479-2c2c8f1cce74(cell1) {{(pid=118472) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:26:14.970229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:14.971820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:14.972640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:14.974618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:14.976617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Registered counter for database nova_cell0 Jun 21 18:26:14.980900 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Registered counter for database nova_cell1 Jun 21 18:26:14.983455 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO dbcounter [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Registered counter for database nova_api Jun 21 18:26:14.988439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:14.990300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:14.998697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:14.999035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.004148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_db.sqlalchemy.engines [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:15.011162 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writer thread running {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.068766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.context [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),770c3dab-ef8d-4f16-8479-2c2c8f1cce74(cell1) {{(pid=118474) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:26:15.073752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:15.075355 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:15.076165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:15.078191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:15.080197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO dbcounter [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Registered counter for database nova_cell0 Jun 21 18:26:15.084267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO dbcounter [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Registered counter for database nova_cell1 Jun 21 18:26:15.092210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_db.sqlalchemy.engines [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:15.094490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_db.sqlalchemy.engines [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:15.102235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writer thread running {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.102732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writer thread running {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.151208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO dbcounter [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Registered counter for database nova_cell0 Jun 21 18:26:15.157867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_db.sqlalchemy.engines [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:15.162254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writer thread running {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.255659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO dbcounter [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Registered counter for database nova_cell0 Jun 21 18:26:15.262937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_db.sqlalchemy.engines [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:26:15.267372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writer thread running {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:26:15.485498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:26:15.492863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:26:15.600652 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: WARNING keystonemiddleware.auth_token [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:26:15.607996 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: WARNING keystonemiddleware.auth_token [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:26:15.838043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:26:15.844330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: WARNING keystonemiddleware.auth_token [None req-b6a935e6-839b-4d33-bb4a-f361d41a3d05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:26:15.850446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f3c1429c0 pid: 118472 (default app) Jun 21 18:26:15.956035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: WARNING keystonemiddleware.auth_token [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:26:15.962472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: WARNING keystonemiddleware.auth_token [None req-35c127fa-0912-4e9c-8590-8800701f2e12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:26:15.967582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f3c1429c0 pid: 118474 (default app) Jun 21 18:26:56.688247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:56.689273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:56.690004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:56.690940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:57.995238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-01c6c8af-a5c3-4580-9ccf-41017d2f37e2 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Action: 'create', calling method: .version_select at 0x7fd39d8a0700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-983556374"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:00.237628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:00.238597 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:00.240064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:00.241170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:00.327614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-01c6c8af-a5c3-4580-9ccf-41017d2f37e2 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.653824 Jun 21 18:27:00.328615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1154 bytes} [Tue Jun 21 18:26:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3657 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 18:27:00.341734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-03d6c494-a507-4edb-8b93-11a2805024b1 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d767550>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:00.455206 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-03d6c494-a507-4edb-8b93-11a2805024b1 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 200 len: 344 microversion: 2.1 time: 0.118604 Jun 21 18:27:00.460324 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:00 2022] GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:00.574707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6122c5f7-3876-4a8c-a6e0-e96d1730fa79 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d8e8310>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:01.070167 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6122c5f7-3876-4a8c-a6e0-e96d1730fa79 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/c39d905a-c3d9-485f-8542-6afdad2ea754" status: 200 len: 350 microversion: 2.1 time: 0.842775 Jun 21 18:27:01.075281 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:00 2022] GET /compute/v2.1/os-volumes/c39d905a-c3d9-485f-8542-6afdad2ea754 => generated 350 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:01.672942 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-24fad10a-5566-4376-8d6c-e78268d9011e tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d7678b0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:01.672942 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-24fad10a-5566-4376-8d6c-e78268d9011e tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 200 len: 345 microversion: 2.1 time: 0.087169 Jun 21 18:27:01.672942 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:01 2022] GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:01.675572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-eb790f65-f8e9-4102-a1fd-28d8ff6b9fd9 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Action: 'create', calling method: .version_select at 0x7fd39d7af670>, body: {"snapshot": {"volume_id": "632b2ba5-cb89-474d-99e2-80e122a015f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-561818682"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:02.408481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-eb790f65-f8e9-4102-a1fd-28d8ff6b9fd9 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.838957 Jun 21 18:27:02.409038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 2/5] 10.222.0.23 () {60 vars in 1161 bytes} [Tue Jun 21 18:27:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:02.420147 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8111b307-4203-46a7-aa6f-6954684f417f tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d767ca0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:02.521082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8111b307-4203-46a7-aa6f-6954684f417f tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 286 microversion: 2.1 time: 0.105158 Jun 21 18:27:02.529711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:02 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:02.534139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f3534c09-2148-43ca-9e04-67d0a02239bf tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d7af430>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:02.781722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f3534c09-2148-43ca-9e04-67d0a02239bf tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.253021 Jun 21 18:27:02.782961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jun 21 18:27:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:02.795030 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3f562201-6f09-4294-a62b-3558debd50e0 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d777430>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:02.849713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3f562201-6f09-4294-a62b-3558debd50e0 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 286 microversion: 2.1 time: 0.059919 Jun 21 18:27:02.851985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:02 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:03.162542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-312b5b94-38f5-4852-9a6e-ad0a205b4573 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d7761f0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:03.276888 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-312b5b94-38f5-4852-9a6e-ad0a205b4573 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d61161b8-4d4d-482c-8a84-bf898284013c" status: 200 len: 350 microversion: 2.1 time: 0.118230 Jun 21 18:27:03.277557 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 4/9] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:03 2022] GET /compute/v2.1/os-volumes/d61161b8-4d4d-482c-8a84-bf898284013c => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:03.863391 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-069af5c5-b22d-4aca-9f71-6756ab06cde6 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d767d30>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:03.906819 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-069af5c5-b22d-4aca-9f71-6756ab06cde6 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 286 microversion: 2.1 time: 0.045987 Jun 21 18:27:03.906819 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:03 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:04.922354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-da688973-c551-43f0-b991-9547c758b1df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d776940>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:05.012936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-da688973-c551-43f0-b991-9547c758b1df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 286 microversion: 2.1 time: 0.099014 Jun 21 18:27:05.023981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:04 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:06.027313 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42e3da19-ee04-49e9-ad66-9b62d81d8608 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d767820>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:06.090633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-42e3da19-ee04-49e9-ad66-9b62d81d8608 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 287 microversion: 2.1 time: 0.068044 Jun 21 18:27:06.091372 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:06 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:06.108157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-62e2a213-7aa8-4909-a515-7da531ece672 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d7afca0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:06.412975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-87dffe1f-12de-43aa-bd45-1e3564c33be9 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d777550>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:06.513114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-87dffe1f-12de-43aa-bd45-1e3564c33be9 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/831e11f0-a2da-42e7-8466-d595237745d8" status: 200 len: 351 microversion: 2.1 time: 0.103915 Jun 21 18:27:06.519808 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:06 2022] GET /compute/v2.1/os-volumes/831e11f0-a2da-42e7-8466-d595237745d8 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:06.526367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3a5f8d4e-c16b-4c85-bf7c-273dc8c1acfd tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d767a60>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:06.589186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-62e2a213-7aa8-4909-a515-7da531ece672 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 202 len: 0 microversion: 2.1 time: 0.485581 Jun 21 18:27:06.593328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 6/14] 10.222.0.23 () {58 vars in 1253 bytes} [Tue Jun 21 18:27:06 2022] DELETE /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:27:06.599005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c386344a-2dfa-4f04-afe0-96b3163fe46e tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39e0c8b80>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:06.675313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c386344a-2dfa-4f04-afe0-96b3163fe46e tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 200 len: 286 microversion: 2.1 time: 0.080534 Jun 21 18:27:06.675933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:06 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:06.816236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3a5f8d4e-c16b-4c85-bf7c-273dc8c1acfd tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.294459 Jun 21 18:27:06.817696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jun 21 18:27:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:06.833982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6eeb0998-fcd0-4eb8-8c85-0ce1ccb3a894 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d7769d0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.151858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6eeb0998-fcd0-4eb8-8c85-0ce1ccb3a894 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.324947 Jun 21 18:27:07.153214 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Jun 21 18:27:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:07.173057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b40a2cf7-0e7a-48e6-944d-f6b2a378c3a0 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d777310>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.422441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b40a2cf7-0e7a-48e6-944d-f6b2a378c3a0 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.258494 Jun 21 18:27:07.423384 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Jun 21 18:27:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:07.436215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9495181c-1427-4df4-bb74-a27cb5a92951 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d7af940>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.615855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9495181c-1427-4df4-bb74-a27cb5a92951 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184563 Jun 21 18:27:07.617003 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Jun 21 18:27:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:07.629769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b70f8993-3604-4a7f-bf2d-90c98838cea2 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d777ee0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.687966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c6507bc-811b-4a80-968b-79cfad5478df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d7761f0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.750378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-5c6507bc-811b-4a80-968b-79cfad5478df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] HTTP exception thrown: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c6507bc-811b-4a80-968b-79cfad5478df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Request method failure captured: Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 HTTP/1.1 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg1wRqNQsiFmit75f4H0izbUmBt-tbLkquKulK7jNnPKP613jdWdH0aKbLuPIiXLpC8GXAisDA3e2NCQ0V0ZYC-cgLkLC6g0sufmgGMw2PtJiHr6ZNMRjvWD7p0DgZExcAr_vEL9JKc080-eHauhRHcFQ5SW7HtFgWDfjub-3nILR14 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:27:07.756332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 61b74b7ef05740fdad199df473316eea Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'a7de13be-09d8-45b4-b685-2e51ba8e7af4'} Jun 21 18:27:07.757754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. (HTTP 404) (Request-ID: req-7c9cecd0-aff4-4cff-b1f2-03d743a02878) Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.758496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:07.759497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 18:27:07.760769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c6507bc-811b-4a80-968b-79cfad5478df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Returning 404 to user: Snapshot a7de13be-09d8-45b4-b685-2e51ba8e7af4 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:27:07.762052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5c6507bc-811b-4a80-968b-79cfad5478df tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4" status: 404 len: 111 microversion: 2.1 time: 0.074762 Jun 21 18:27:07.763039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Jun 21 18:27:07 2022] GET /compute/v2.1/os-snapshots/a7de13be-09d8-45b4-b685-2e51ba8e7af4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:27:07.783823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6164cd39-77f3-4c95-82b3-c735344ccd32 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d776c10>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:07.867895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b70f8993-3604-4a7f-bf2d-90c98838cea2 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.242204 Jun 21 18:27:07.869434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Jun 21 18:27:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:07.881733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-81c6edce-2fd3-4845-b54f-6bbeef62f5d4 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d777d30>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:08.027371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6164cd39-77f3-4c95-82b3-c735344ccd32 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 202 len: 0 microversion: 2.1 time: 0.256813 Jun 21 18:27:08.028615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 11/22] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:27:07 2022] DELETE /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:27:08.036938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ac8ab727-93ab-402f-a752-02df928648d0 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d6db4c0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:08.101832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-81c6edce-2fd3-4845-b54f-6bbeef62f5d4 tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.224153 Jun 21 18:27:08.102711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jun 21 18:27:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:08.115129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bd713070-6e64-4c8a-a5af-d3bbf132dedf tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d767dc0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:08.151521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ac8ab727-93ab-402f-a752-02df928648d0 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 200 len: 344 microversion: 2.1 time: 0.118244 Jun 21 18:27:08.152076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:08 2022] GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:08.235486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bd713070-6e64-4c8a-a5af-d3bbf132dedf tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.123457 Jun 21 18:27:08.236993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Jun 21 18:27:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:08.254377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c56013e6-41dc-49a1-932c-202b3185d6fa tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] Calling method '.version_select at 0x7fd39d776c10>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:08.441841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c56013e6-41dc-49a1-932c-202b3185d6fa tempest-VolumesTestJSON-972176126 tempest-VolumesTestJSON-972176126-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.191737 Jun 21 18:27:08.443447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Jun 21 18:27:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:09.167781 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b2c0c5a-aef2-4589-a891-a3d37f60fc04 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d709040>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:09.256843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-0b2c0c5a-aef2-4589-a891-a3d37f60fc04 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] HTTP exception thrown: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b2c0c5a-aef2-4589-a891-a3d37f60fc04 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Request method failure captured: Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 HTTP/1.1 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg1wRqNQsiFmit75f4H0izbUmBt-tbLkquKulK7jNnPKP613jdWdH0aKbLuPIiXLpC8GXAisDA3e2NCQ0V0ZYC-cgLkLC6g0sufmgGMw2PtJiHr6ZNMRjvWD7p0DgZExcAr_vEL9JKc080-eHauhRHcFQ5SW7HtFgWDfjub-3nILR14 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:27:09.261771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 61b74b7ef05740fdad199df473316eea Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '632b2ba5-cb89-474d-99e2-80e122a015f5'} Jun 21 18:27:09.262939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. (HTTP 404) (Request-ID: req-c43cf239-7dfa-4b67-89ac-fdadea018018) Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.264197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:09.265172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:27:09.266094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.267000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.269104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b2c0c5a-aef2-4589-a891-a3d37f60fc04 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Returning 404 to user: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:27:09.277690 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0b2c0c5a-aef2-4589-a891-a3d37f60fc04 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 404 len: 109 microversion: 2.1 time: 0.107121 Jun 21 18:27:09.288780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:09 2022] GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:27:09.293855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-91916d2d-3c14-4082-a772-4dd3f586b2f8 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d6dbaf0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:09.350310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-91916d2d-3c14-4082-a772-4dd3f586b2f8 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] HTTP exception thrown: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-91916d2d-3c14-4082-a772-4dd3f586b2f8 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Request method failure captured: Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 HTTP/1.1 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg1wRqNQsiFmit75f4H0izbUmBt-tbLkquKulK7jNnPKP613jdWdH0aKbLuPIiXLpC8GXAisDA3e2NCQ0V0ZYC-cgLkLC6g0sufmgGMw2PtJiHr6ZNMRjvWD7p0DgZExcAr_vEL9JKc080-eHauhRHcFQ5SW7HtFgWDfjub-3nILR14 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:27:09.352475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 61b74b7ef05740fdad199df473316eea Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '632b2ba5-cb89-474d-99e2-80e122a015f5'} Jun 21 18:27:09.354306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. (HTTP 404) (Request-ID: req-d936ba20-8e38-438f-b02f-cfbe637a1311) Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.354973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:27:09.355896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:27:09.357582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-91916d2d-3c14-4082-a772-4dd3f586b2f8 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Returning 404 to user: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-91916d2d-3c14-4082-a772-4dd3f586b2f8 tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 404 len: 109 microversion: 2.1 time: 0.065661 Jun 21 18:27:09.359157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 14/28] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:27:09 2022] DELETE /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:27:09.370921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fef2e82b-8ae4-4e50-9f0b-fc0d7a78483d tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Calling method '.version_select at 0x7fd39d777ca0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-fef2e82b-8ae4-4e50-9f0b-fc0d7a78483d tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] HTTP exception thrown: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fef2e82b-8ae4-4e50-9f0b-fc0d7a78483d tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Request method failure captured: Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 HTTP/1.1 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg1wRqNQsiFmit75f4H0izbUmBt-tbLkquKulK7jNnPKP613jdWdH0aKbLuPIiXLpC8GXAisDA3e2NCQ0V0ZYC-cgLkLC6g0sufmgGMw2PtJiHr6ZNMRjvWD7p0DgZExcAr_vEL9JKc080-eHauhRHcFQ5SW7HtFgWDfjub-3nILR14 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:27:09.436338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3bfd39123f64e27805ea90036c1340c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: d3bfd39123f64e27805ea90036c1340c Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752328731 Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 61b74b7ef05740fdad199df473316eea Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752328731-project Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '632b2ba5-cb89-474d-99e2-80e122a015f5'} Jun 21 18:27:09.437832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. (HTTP 404) (Request-ID: req-673836c8-fbae-4f58-887a-bcbabb09fac4) Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.438489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:27:09.439447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:27:09.440451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fef2e82b-8ae4-4e50-9f0b-fc0d7a78483d tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] Returning 404 to user: Volume 632b2ba5-cb89-474d-99e2-80e122a015f5 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fef2e82b-8ae4-4e50-9f0b-fc0d7a78483d tempest-VolumesSnapshotsTestJSON-1752328731 tempest-VolumesSnapshotsTestJSON-1752328731-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5" status: 404 len: 109 microversion: 2.1 time: 0.076519 Jun 21 18:27:09.441389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:27:09 2022] GET /compute/v2.1/os-volumes/632b2ba5-cb89-474d-99e2-80e122a015f5 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:27:15.958055 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-611834101", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "networks": [{"uuid": "b73d4419-a712-4f4b-8399-64f18ef8d309"}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:16.293779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] validate_networks() for [('b73d4419-a712-4f4b-8399-64f18ef8d309', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:27:17.203013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5d1c1c26-eab0-4edd-98d0-930ff31c47ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: .version_select at 0x7fd39d777670>, body: {"keypair": {"name": "tempest-keypair-980827203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7FYMEGIk4MTki/6XmwEh0nFFZEmBmP8Asv+fLCElnXGDU4tY3QVjz+ZlfycGzszVAUPUGnR7czuy3GW8oWGgYRrAPI2LAUaxmJ7wvCtAlFebOH4+MZOUDiXZRcrD/iEQ=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:17.258670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-5d1c1c26-eab0-4edd-98d0-930ff31c47ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:17.267896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-5d1c1c26-eab0-4edd-98d0-930ff31c47ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:17.436027 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5d1c1c26-eab0-4edd-98d0-930ff31c47ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.888547 Jun 21 18:27:17.437358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 16/30] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:27:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:17.816476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7761f138-12ff-411b-9709-8df9826224c2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: .version_select at 0x7fd39d6405e0>, body: {"keypair": {"name": "tempest-keypair-1433878041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECbQ8JvHK6GQDrVjAtZT47E9mxcj0FTyV2C5WR3hIFaTvPPxsjyu4k1LBZUDipPpsby5R96Nxub64en9ttmEDkEmQV5phKXKen8wweuFDEWUeWAlXA6Ktckmq58hYnnag=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:17.862863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-7761f138-12ff-411b-9709-8df9826224c2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:17.892608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-7761f138-12ff-411b-9709-8df9826224c2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for user e03c3a73166b4bbe9fca6d18ecf59221 and project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:18.068859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7761f138-12ff-411b-9709-8df9826224c2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.629039 Jun 21 18:27:18.070476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 17/31] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jun 21 18:27:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 632 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 18:27:18.996137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:27:18.997850 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:27:19.000200 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:27:19.001175 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:27:19.002059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:27:19.179400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:19.180154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:19.188453 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:19.191357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:19.426118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Getting quotas for project 7e5e18f0b6ab45ef961c14b967941ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:19.491820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Getting quotas for user 35d70344216248199ddf81fba88af04f and project 7e5e18f0b6ab45ef961c14b967941ca6. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:19.581194 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:27:19.584192 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:27:19.961964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-da8369a7-9dd2-4894-ad69-a5653b03694b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.520892 Jun 21 18:27:19.963956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 15/32] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:27:19.974602 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eb52396d-6289-4e6b-9b98-fc2fef8bddc2 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:19.976170 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eb52396d-6289-4e6b-9b98-fc2fef8bddc2 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:20.396820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eb52396d-6289-4e6b-9b98-fc2fef8bddc2 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:20.458692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eb52396d-6289-4e6b-9b98-fc2fef8bddc2 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1214 microversion: 2.1 time: 0.488055 Jun 21 18:27:20.466511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:19 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1214 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:21.487802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8f6060c9-6ed7-4bbb-87a6-1e3d1200451b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:21.494103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8f6060c9-6ed7-4bbb-87a6-1e3d1200451b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:21.596696 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1167359570", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:21.800065 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] validate_networks() for [('c311bd00-da3b-4520-a15e-cdf04bcdf59d', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:27:21.952430 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8f6060c9-6ed7-4bbb-87a6-1e3d1200451b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:21.957955 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8f6060c9-6ed7-4bbb-87a6-1e3d1200451b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1214 microversion: 2.1 time: 0.474113 Jun 21 18:27:21.970581 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 19/34] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:21 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1214 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:22.990453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c3a57678-dd74-464d-86f1-c72a4a315df8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:22.992126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c3a57678-dd74-464d-86f1-c72a4a315df8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:23.121489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:27:23.122141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:27:23.128344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:27:23.128344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:27:23.128344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:27:23.135523 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:23.136229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:23.137280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:23.138045 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:23.162275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:23.168123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for user 59f011e91b684e1288dad5f0ac733c0f and project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:23.181640 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:27:23.183849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:27:23.239107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c3a57678-dd74-464d-86f1-c72a4a315df8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:23.257739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c3a57678-dd74-464d-86f1-c72a4a315df8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1214 microversion: 2.1 time: 0.272168 Jun 21 18:27:23.272293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 20/35] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:22 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:23.348335 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-feb5177e-6f19-4fc3-b4b9-7e7b0d43041b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.954928 Jun 21 18:27:23.349053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 16/36] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:27:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:27:23.374934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cb03143b-7697-413e-b3a1-670198c43451 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:23.384965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cb03143b-7697-413e-b3a1-670198c43451 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:23.580852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cb03143b-7697-413e-b3a1-670198c43451 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:23.593661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cb03143b-7697-413e-b3a1-670198c43451 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1222 microversion: 2.1 time: 0.237669 Jun 21 18:27:23.598646 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 21/37] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:23 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:23.669616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1672831523", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89bb927a-5407-4745-a764-78e1bdbbf5fe"}], "security_groups": [{"name": "tempest-securitygroup--765209374"}], "key_name": "tempest-keypair-980827203", "user_data": "}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:23.990312 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] validate_networks() for [('89bb927a-5407-4745-a764-78e1bdbbf5fe', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:27:24.282559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:24.283164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:24.298734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:24.303528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:24.304705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:24.310459 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:24.636804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:24.652322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eb3001e0-fff5-4ee7-a68e-18630440fdf1 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1218 microversion: 2.1 time: 0.380844 Jun 21 18:27:24.653200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 22/38] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:24 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1218 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:24.674687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1953625936", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:25.031312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] validate_networks() for [('c311bd00-da3b-4520-a15e-cdf04bcdf59d', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:27:25.450434 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:27:25.451461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:27:25.452227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:27:25.452821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:27:25.453389 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:27:25.503210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:25.511530 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:25.514524 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:25.517174 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:25.607322 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:25.616705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:25.631108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:27:25.634336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:27:25.813472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6afbde01-34a2-4ead-b08f-24df1e68d2be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.148635 Jun 21 18:27:25.817233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 17/39] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:27:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:27:25.839206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1450625761", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6317d84-2f6b-44fa-b7b5-4146bb43cc39"}], "security_groups": [{"name": "tempest-securitygroup--938441498"}], "key_name": "tempest-keypair-1433878041", "user_data": "}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:26.163627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] validate_networks() for [('a6317d84-2f6b-44fa-b7b5-4146bb43cc39', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:27:27.008693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:27:27.008693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:27:27.010428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:27:27.010858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:27:27.012326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:27:27.037740 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.041734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.042961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.043415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.068927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:27.074344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for user e03c3a73166b4bbe9fca6d18ecf59221 and project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:27.088176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:27:27.090391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:27:27.251865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:27:27.253141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:27:27.253778 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:27:27.254330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:27:27.254890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:27:27.302067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.302067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.302067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.302378 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.337926 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:27:27.359382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fb0b8057-d61b-4358-9b01-3b641e60c59e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.523024 Jun 21 18:27:27.367127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 18/40] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jun 21 18:27:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 18:27:27.385319 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:27.389785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:27.392265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for user 59f011e91b684e1288dad5f0ac733c0f and project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:27:27.450302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.453978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.455546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.458515 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.493118 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:27:27.500914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:27:27.815940 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:27.910845 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b66d61fb-0266-48c9-954b-2939b0c57e4a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1272 microversion: 2.1 time: 0.538478 Jun 21 18:27:27.912087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:27 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1272 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:27.919136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:27.921137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:27.930325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.931099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.934022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:27.939657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:27.951870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0bfb060f-66ff-4878-bd74-b69bdfa971e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.293459 Jun 21 18:27:27.952831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 23/42] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:27:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:27:27.987774 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:27.997468 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:28.286632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:28.301568 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:28.303298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:28.309232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6d357c79-56fc-4213-9a4b-85ecc96e9ba3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1282 microversion: 2.20 time: 0.352669 Jun 21 18:27:28.311451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 24/43] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:27 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1282 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:28.327510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-502bc853-2692-49ae-8a24-b64719f22c4d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:28.328109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:28.333787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-502bc853-2692-49ae-8a24-b64719f22c4d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:28.374089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2aebad6c-2bbc-495f-b821-97197119ffed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1245 microversion: 2.1 time: 0.448721 Jun 21 18:27:28.379014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 20/44] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:27 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1245 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:28.719977 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-502bc853-2692-49ae-8a24-b64719f22c4d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:28.738436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-502bc853-2692-49ae-8a24-b64719f22c4d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1222 microversion: 2.1 time: 0.424025 Jun 21 18:27:28.740530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 25/45] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:28 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1222 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:28.934273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:28.935253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:28.958050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:28.958840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:28.961008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:28.966537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:29.096764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:29.106297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8f1049f6-c80f-4952-a757-d6ac8b4ff4a6 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1272 microversion: 2.1 time: 0.176846 Jun 21 18:27:29.127427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 21/46] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:28 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:29.328667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:29.330112 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:29.392698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:29.393450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:29.410215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:29.410736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:29.422280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:29.424870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:29.616642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:29.625938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b21ceb5f-81da-407e-88da-a8ed902a7f5e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1293 microversion: 2.1 time: 0.237506 Jun 21 18:27:29.636972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 22/47] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:29 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1293 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:29.758371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-228870b4-aabd-49a5-bb20-3584abc2f63d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:29.759143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-228870b4-aabd-49a5-bb20-3584abc2f63d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:30.010442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.022199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.027120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.044139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-05cdcd4a-aa05-487d-943e-b7646d129676 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1282 microversion: 2.20 time: 0.717987 Jun 21 18:27:30.048696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 26/48] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:29 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1282 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:30.131812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:30.132914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:30.174831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:30.175453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:30.180129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:30.181843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:30.274249 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-228870b4-aabd-49a5-bb20-3584abc2f63d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.302595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-228870b4-aabd-49a5-bb20-3584abc2f63d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1222 microversion: 2.1 time: 0.548425 Jun 21 18:27:30.307170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 23/49] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:29 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1222 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:30.653381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:30.655121 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:30.664751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:30.666732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:30.667885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:30.668875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:30.703250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.730197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2650a636-6072-4532-9f81-bd77c062fccc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.603426 Jun 21 18:27:30.734607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 27/50] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:30 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:30.777320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:30.793444 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-75468986-46a4-459d-bc39-3a4570b595be tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1311 microversion: 2.1 time: 0.154068 Jun 21 18:27:30.794816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 24/51] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:30 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:31.079820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:31.081628 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:31.108219 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.108882 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.111575 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.112006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.292436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:31.305416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:31.309599 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:31.313521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9df4e2e6-8c52-423d-b33c-cc2fbcac5328 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1334 microversion: 2.20 time: 0.250668 Jun 21 18:27:31.322703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:31.324315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:31.326365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 28/52] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:31 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1334 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:31.345729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.353099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.357557 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.358370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.491962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:31.503364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-be240f0d-6115-4dc3-b815-76c46c16ccc0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1218 microversion: 2.1 time: 0.185532 Jun 21 18:27:31.503862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 25/53] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:31 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:31.746039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:31.750773 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:31.763235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.765005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.766171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.771968 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.813627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:31.814305 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:31.822118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.822878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.823857 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:31.824300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:31.959598 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:32.006976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-046080d7-42d3-4a11-8a3a-4cf41b13bfef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1299 microversion: 2.1 time: 0.167428 Jun 21 18:27:32.011540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 26/54] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:31 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:32.333942 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:32.334916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:32.380430 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:32.390568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:32.394930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:32.396966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:32.864972 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:32.877666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:32.901091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-992efa1e-700f-44d0-87fc-20c9295153dd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 1.159388 Jun 21 18:27:32.905975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:32.913164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:32.914847 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 29/55] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:31 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:32.917800 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2ac5e605-6ed7-4af4-b8c2-eb28e6636ff6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1342 microversion: 2.20 time: 0.584546 Jun 21 18:27:32.919715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 27/56] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:32 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1342 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:32.930450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:32.935878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:32.962645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:32.963696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:32.973819 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:32.974858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.035043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:33.036086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:33.046773 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.051289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.052336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.053307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.140203 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:33.147842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5b6dff5e-0c0c-447f-8a11-5ac8d7ce8822 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1274 microversion: 2.1 time: 0.228737 Jun 21 18:27:33.158561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 30/57] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:32 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:33.181889 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:33.197327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7e8cbcd5-eb14-4798-99fe-c4018f375356 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1299 microversion: 2.1 time: 0.164239 Jun 21 18:27:33.201193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 28/58] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:33 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:33.922754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:33.926263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:33.941816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:33.943947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:33.951486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.952759 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.953779 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.954925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.963416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.963862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:33.976920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:33.976920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.120233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.134608 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.140542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.141719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8f36fac5-4c25-4a36-bced-f7db33558b3a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.203984 Jun 21 18:27:34.154582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 29/59] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:33 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:34.176005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:34.176654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:34.193274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.193776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.194609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.195040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.297815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.299118 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.310868 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d1912ab4-f101-41e8-886c-609a8a3b539c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.394121 Jun 21 18:27:34.311057 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0cc912a8-f8c4-458c-919c-f2c7dd1c18c3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1274 microversion: 2.1 time: 0.139086 Jun 21 18:27:34.312588 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 30/60] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:34 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:34.322307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 31/61] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:33 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:34.328906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:34.329698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:34.337193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.337821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.338766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.339357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.552169 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:34.584190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-574ef5f5-9545-4851-9fb3-281630f0235f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.260364 Jun 21 18:27:34.585378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:34 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:34.826116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-82165246-8f26-43d8-9278-3ce9b2f9fde5 req-b85b87e1-10c1-4123-be23-e9e2d5cc590f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f19bd8-9c3f-430a-936a-ff8ca5edfca2", "tag": "400961d5-eace-44ab-9e38-40bb8269844d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:34.846229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-82165246-8f26-43d8-9278-3ce9b2f9fde5 req-b85b87e1-10c1-4123-be23-e9e2d5cc590f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.847672 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-82165246-8f26-43d8-9278-3ce9b2f9fde5 req-b85b87e1-10c1-4123-be23-e9e2d5cc590f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.876239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-82165246-8f26-43d8-9278-3ce9b2f9fde5 req-b85b87e1-10c1-4123-be23-e9e2d5cc590f service nova] Creating event network-changed:400961d5-eace-44ab-9e38-40bb8269844d for instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 on hv-cinder-83124 Jun 21 18:27:34.877057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-82165246-8f26-43d8-9278-3ce9b2f9fde5 req-b85b87e1-10c1-4123-be23-e9e2d5cc590f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 18:27:34.878805 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.879423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.883452 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:34.885416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:34.896267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.compute.rpcapi [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 18:27:34.897562 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] Releasing lock "compute-rpcapi-router" {{(pid=118472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 18:27:34.928160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0362e6d3-3913-45b4-9a88-bceabce5398d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214382 Jun 21 18:27:34.929939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 32/63] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:35.162206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:35.163572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:35.174127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.174574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.175527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.176114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.252843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.261176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.262703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.263804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b0deec69-65fb-4d13-b980-6646f6916a26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.105988 Jun 21 18:27:35.264369 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:35 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:35.329326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:35.330047 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:35.330158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:35.330829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:35.333350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:35.337583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.337725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.338074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.338176 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.338873 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.338972 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.339369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.339477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.406297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.415616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f96947cc-3616-43f4-8350-38acf332b922 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.089839 Jun 21 18:27:35.420547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:35 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:35.479601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.487317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e1ceb738-ae57-495e-806d-7c8ae3283c78 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.161843 Jun 21 18:27:35.487892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:35 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:35.603647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:35.604656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:35.611802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.614037 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.614037 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:35.614037 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:35.763919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:35.774312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e8bba593-f281-433f-959c-7ec8536d5a2c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.174973 Jun 21 18:27:35.774718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:35 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:36.282036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:36.282646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:36.290217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.292668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.292668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.292668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.362661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.377360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.380892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.382076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b4fe2347-0104-4015-9040-ffc09d8096db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.104166 Jun 21 18:27:36.382817 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:36 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:36.433115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:36.434574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:36.440910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.441406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.442167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.442590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.510899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:36.511514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:36.512416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.522317 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a33252b3-7ac0-4667-a781-3771231738c6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.093640 Jun 21 18:27:36.525283 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:36 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:36.536838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.537289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.538159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.538692 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.544633 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:36.685834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.693773 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ca7fa7ea-8263-47f9-be1b-b2ac7b040978 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.187280 Jun 21 18:27:36.694360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:36 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:36.791649 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:36.792297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:36.798963 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.799442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.800558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:36.800988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:36.973313 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:36.995998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-44da2563-7df9-4134-ba6a-c8b184c5b746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.197852 Jun 21 18:27:36.995998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 36/71] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:36 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:37.402553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:37.403182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:37.405064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=8 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:37.410002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.410617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.411375 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.411802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.496239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:37.503383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:37.505029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:37.506224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1a548578-f620-4326-921e-fbb09a04c7ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.109845 Jun 21 18:27:37.506867 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:37 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:37.539763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:37.540516 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:37.546507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.546948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.547826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.548642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.620239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:37.628277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-55fdfd27-a09d-4dae-9d4e-9e857395df94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.092266 Jun 21 18:27:37.630447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 37/73] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:37 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:37.711607 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:37.712787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:37.719891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.721080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.722064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:37.722660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:37.897220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:37.904987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-47720ec7-e04e-49b4-adb3-722b55c1f9a9 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.197678 Jun 21 18:27:37.905641 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:37 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:38.003366 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:38.008680 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:38.019978 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.020439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.021244 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.021841 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.210901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:38.221325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-42254c67-e4eb-4c7f-9314-e4a44e22578d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.221403 Jun 21 18:27:38.225519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 38/75] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:37 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:38.526241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:38.527649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:38.536204 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.536928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.538226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.538862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.634287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:38.646160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:38.646928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:38.656279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.661661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.661661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.661661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.661963 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:38.663645 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:38.665293 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3f9db90b-4100-4034-9631-f53cee04afaf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.143667 Jun 21 18:27:38.674473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:38 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:38.755507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:38.764486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1a85914e-f8e2-42ac-90fd-6fd517ec85bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.122458 Jun 21 18:27:38.765072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:38 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:38.922495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:38.923421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:38.936953 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.937321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:38.938100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:38.938536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.150471 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.159235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-51cd17ff-9f4f-4665-9845-7e827b333ebd tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.240688 Jun 21 18:27:39.159859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 39/78] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:38 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:39.242626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:39.246356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:39.250404 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.250857 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.251677 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.252104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.404994 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.416111 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c053b774-c603-48a9-bc01-e5de6ecfab6a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.177098 Jun 21 18:27:39.416763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 40/79] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:39 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:39.694712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:39.695405 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:39.702890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.703348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.704148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.704620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.782488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:39.783486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:39.787066 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:39.798865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.799413 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.800531 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:39.802294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:39.812857 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.822475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.830302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.831646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7b65c2c8-4e07-44f4-9426-116d557fc908 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.150598 Jun 21 18:27:39.832755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 40/80] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:39 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:39.890119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:39.900377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-846c6693-96d4-4e30-91a4-78be6437bca1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.121731 Jun 21 18:27:39.902772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 41/81] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:39 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:40.177532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:40.178273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:40.187978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.188767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.189576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.190009 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.292206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=26 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:40.336554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:40.345136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d0ea7c67-f773-4468-9b38-96ce0cf39ff8 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.171935 Jun 21 18:27:40.345706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 41/82] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:40 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:40.432857 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:40.433711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:40.436730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=28 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:40.442487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.442936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.443744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.444182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.465582 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:40.592692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:40.600601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-02520063-5525-4461-bd2a-fbc76be93b06 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.171650 Jun 21 18:27:40.601172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 42/83] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:40 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:40.851534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:40.852150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:40.861983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.862514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.863280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.863711 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.920372 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:40.921097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:40.928988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.929433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.930199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:40.931332 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:40.950713 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:40.959074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:40.960599 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:40.962303 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-575d0aa5-97ec-4b91-930f-74f1cf2d7000 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.114162 Jun 21 18:27:40.968941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 42/84] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:40 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:40.997601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:41.005711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fcf88548-d0b6-425e-bf19-80516af476af tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1282 microversion: 2.1 time: 0.089936 Jun 21 18:27:41.006284 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:40 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:41.362948 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:41.363558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:41.377848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:41.378304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:41.379254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:41.379681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:41.619433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:41.620230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:41.627102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:41.627670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:41.628488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:41.629074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:41.894991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:41.903731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-785a7b71-7065-4494-86cc-169c011bb516 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.544396 Jun 21 18:27:41.904828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:41 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:41.983892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:41.984836 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:42.002964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.003679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:42.005519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.005983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:42.267685 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:42.276190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3f7529d0-c0bd-4a48-866d-7a4e4b949605 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.661420 Jun 21 18:27:42.286029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 44/87] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:41 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:42.297302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:42.298206 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:42.305270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.307276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:42.308212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.308854 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:42.441039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:42.450911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1aed64d0-f6a6-4ea0-9898-1b7adb02b597 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1280 microversion: 2.1 time: 0.162803 Jun 21 18:27:42.451493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:42 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:42.466157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:42.476991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:42.479626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:42.481625 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-aff05dbb-04b6-424b-b7b1-8d8d389d5ce2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1340 microversion: 2.20 time: 0.504430 Jun 21 18:27:42.517422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 44/89] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:41 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1340 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:42.922212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:42.923647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:42.932287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.933017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:42.933861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:42.934664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.278165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-f64502c1-9f07-4cf1-abc9-9031db18b132 req-c722e5da-c3cf-44cf-abe4-27f901fdb60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b830661-c720-48f3-95c1-803626d60a9d", "tag": "2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:43.311399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f64502c1-9f07-4cf1-abc9-9031db18b132 req-c722e5da-c3cf-44cf-abe4-27f901fdb60f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.312347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f64502c1-9f07-4cf1-abc9-9031db18b132 req-c722e5da-c3cf-44cf-abe4-27f901fdb60f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.358534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-f64502c1-9f07-4cf1-abc9-9031db18b132 req-c722e5da-c3cf-44cf-abe4-27f901fdb60f service nova] Creating event network-changed:2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0 for instance 7b830661-c720-48f3-95c1-803626d60a9d on hv-cinder-83124 Jun 21 18:27:43.362167 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f64502c1-9f07-4cf1-abc9-9031db18b132 req-c722e5da-c3cf-44cf-abe4-27f901fdb60f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 18:27:43.366385 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.367126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.372756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.373218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.400277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.compute.rpcapi [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 18:27:43.401542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] Releasing lock "compute-rpcapi-router" {{(pid=118474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 18:27:43.448573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8a483f6d-25d8-48f0-a0fe-e9df3f7b9965 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175772 Jun 21 18:27:43.449509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 45/90] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:43.460483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:43.461714 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:43.477785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.480790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.484144 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.484852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.802103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:43.819228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c98f6225-623c-4c2e-a1cc-ad92a356896b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.901712 Jun 21 18:27:43.819832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:42 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:43.841274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:43.842116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:43.849297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.849985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.850953 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.851553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.897250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:43.916667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d65e1b31-37b8-42ee-80ef-1e900ef78ec1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.463843 Jun 21 18:27:43.919433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:43 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:43.940736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:43.941688 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:43.962802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.964100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:43.968451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:43.969331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:44.128443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:44.141203 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa814453-53d6-44fe-bdbf-fa7b6017a53a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1280 microversion: 2.1 time: 0.303634 Jun 21 18:27:44.142123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:43 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:44.246814 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:44.259428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:44.261702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:44.263040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-548edd37-bbc4-485a-924a-4e781274c4ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.342208 Jun 21 18:27:44.263802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 47/94] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:43 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:44.839047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:44.841052 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:44.849578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:44.850097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:44.850967 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:44.851321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:44.894134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:44.935331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:44.935944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:44.942169 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:44.942643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:44.943420 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:44.943851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.018854 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.028918 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-257d6882-e388-4669-8ab1-6c64493ca1e3 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.195003 Jun 21 18:27:45.031082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:44 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:45.133942 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.141437 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b1faa7a0-378c-4320-9977-868315739e9b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.210195 Jun 21 18:27:45.142010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 48/96] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:44 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:45.158919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:45.160136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:45.167268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:45.167890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.168902 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:45.169348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.281960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:45.282772 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:45.289110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:45.289700 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.290649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:45.291161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.349017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.357069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-302e3167-8e52-46b3-82ea-1d76a8a8f4d5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.202325 Jun 21 18:27:45.357657 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 49/97] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:45 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:45.423930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.432234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.433916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:45.435038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c09dcc20-f474-4801-9eb2-1b1c5ccb929d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.157114 Jun 21 18:27:45.435609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 49/98] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:45 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:45.562866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-39cc94b2-1193-4989-b0d4-d027ce71647e req-9398dcff-1991-41c0-96f8-845a34d9dfdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6b7d00-7d63-4188-a97f-783156275509", "tag": "06a0d32e-021c-4849-a7d1-7e11d1247848"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:45.571025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-39cc94b2-1193-4989-b0d4-d027ce71647e req-9398dcff-1991-41c0-96f8-845a34d9dfdb service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:45.571986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-39cc94b2-1193-4989-b0d4-d027ce71647e req-9398dcff-1991-41c0-96f8-845a34d9dfdb service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:45.582776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-39cc94b2-1193-4989-b0d4-d027ce71647e req-9398dcff-1991-41c0-96f8-845a34d9dfdb service nova] Creating event network-changed:06a0d32e-021c-4849-a7d1-7e11d1247848 for instance db6b7d00-7d63-4188-a97f-783156275509 on hv-cinder-83124 Jun 21 18:27:45.587694 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-39cc94b2-1193-4989-b0d4-d027ce71647e req-9398dcff-1991-41c0-96f8-845a34d9dfdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028643 Jun 21 18:27:45.588525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 50/99] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:46.046556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:46.047154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:46.053163 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.053605 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.054360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.054789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.161851 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:46.163482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:46.171199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.171829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.172748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.173336 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.430771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.430771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5789780a-ea57-4fa0-8678-333fd4955c6e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.180190 Jun 21 18:27:46.430771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 51/100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:46 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:46.430771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:46.432503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:46.432503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.432503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.432503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.432909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.433020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.433020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-64bc6ad0-3e8f-4bc2-9b1a-990cd1a20259 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.359010 Jun 21 18:27:46.433020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:46 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:46.453446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:46.453964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:46.460428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.460956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.462543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:46.463248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:46.539200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.546480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-df7167fa-5384-4522-8ea3-c31757da8273 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.175713 Jun 21 18:27:46.548586 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 52/102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:46 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:46.610378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.619404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.621030 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:46.622326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4e7dee16-b1db-4c47-b5bb-08eb45dc8665 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.172907 Jun 21 18:27:46.622901 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 51/103] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:46 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:47.449489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:47.450445 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:47.451814 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:47.452482 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:47.456134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.456616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.457373 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.457798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.458463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.458916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.459675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.460110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.465843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:47.604203 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:47.606251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:47.613861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-68d67f77-f9d7-4f14-9c6f-e298a97b2ca2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.168012 Jun 21 18:27:47.614221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a3b7be69-f826-4d40-9a5f-86ad428584be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.166312 Jun 21 18:27:47.614775 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 53/104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:47 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:47.624356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 52/105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:47 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:47.629323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:47.631903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:47.640550 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.644698 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.644832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:47.645494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:47.645991 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.646450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.654926 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.655439 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:47.656776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:47.657754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:48.032661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:48.040890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:48.042469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:48.043597 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-775f68c3-ba41-4cf6-b568-b6d1b8e0e0dc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.406426 Jun 21 18:27:48.044170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 53/106] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:47 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:48.199222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:48.208058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-31dfaf7a-3d12-496e-b893-3ac65510c958 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.592011 Jun 21 18:27:48.209325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:47 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:48.637720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:48.641088 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:48.644025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:48.647556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:48.671981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:48.673531 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:48.678766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:48.681007 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:48.682231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:48.683137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:48.683662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:48.686371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:48.981815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:48.996251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e5f4ede0-048b-4d54-82d2-73ea21268a7d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.364828 Jun 21 18:27:49.013663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:48 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:49.060860 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:49.065300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:49.066251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:49.078538 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.081142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.082821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.085620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.091612 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-509460ec-3df8-45dc-b757-c47b64fac8ab tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.457518 Jun 21 18:27:49.092262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 54/109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:48 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:49.303585 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-6e40752a-451c-4200-b913-62b25e641ee8 req-22ce20c0-deb3-498a-b74b-5b05eb374fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:49.313941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-6e40752a-451c-4200-b913-62b25e641ee8 req-22ce20c0-deb3-498a-b74b-5b05eb374fc1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.314618 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-6e40752a-451c-4200-b913-62b25e641ee8 req-22ce20c0-deb3-498a-b74b-5b05eb374fc1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.328297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-6e40752a-451c-4200-b913-62b25e641ee8 req-22ce20c0-deb3-498a-b74b-5b05eb374fc1 service nova] Creating event network-changed:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:27:49.329265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:49.339184 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-6e40752a-451c-4200-b913-62b25e641ee8 req-22ce20c0-deb3-498a-b74b-5b05eb374fc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126301 Jun 21 18:27:49.343727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:49.343909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 55/110] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:49.345496 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:49.346776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2c58eeaa-a0ec-48a0-a6df-e06246db74f9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.289155 Jun 21 18:27:49.351233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:49.352268 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:49.358226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 56/111] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:49 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:49.360868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.361558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.362531 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.363097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.364802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fb4f1142-49d9-4c99-8387-2c4ab1324105 req-3e8966f1-54a8-46de-ac20-a9e4c694f618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128ab49-7ea8-40c8-a008-69a7ceac7769", "tag": "9ebf45b0-5fbf-431b-85c1-01218c94add8"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:49.374651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fb4f1142-49d9-4c99-8387-2c4ab1324105 req-3e8966f1-54a8-46de-ac20-a9e4c694f618 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:49.375097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fb4f1142-49d9-4c99-8387-2c4ab1324105 req-3e8966f1-54a8-46de-ac20-a9e4c694f618 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:49.388740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fb4f1142-49d9-4c99-8387-2c4ab1324105 req-3e8966f1-54a8-46de-ac20-a9e4c694f618 service nova] Creating event network-changed:9ebf45b0-5fbf-431b-85c1-01218c94add8 for instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 on hv-cinder-83124 Jun 21 18:27:49.395012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fb4f1142-49d9-4c99-8387-2c4ab1324105 req-3e8966f1-54a8-46de-ac20-a9e4c694f618 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 Jun 21 18:27:49.395838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 57/112] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:49.518856 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:49.527079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-50bcf063-af71-4917-bba0-778550034c52 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.181568 Jun 21 18:27:49.527601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 56/113] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:49 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:50.021065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:50.021809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:50.029610 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.030057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.030823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.031258 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.115612 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:50.117545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:50.135126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.135126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.135126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.135126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.180840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.183399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-be6a422e-6243-465f-aa1b-700a68782e4c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.166806 Jun 21 18:27:50.191261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 58/114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:50 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:50.276457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.284191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2942039c-46fe-45a2-8406-fc7a3052bbcc tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.173592 Jun 21 18:27:50.284783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 57/115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:50 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:50.365294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:50.365905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:50.372687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.373141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.374162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.374598 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.545262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:50.546147 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:50.551622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.552779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.553431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.554382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:50.554983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:50.561365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.562878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.564003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9128c5ea-43be-48f9-a60f-f0a7b060f96c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.202631 Jun 21 18:27:50.564576 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 59/116] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:50 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:50.762001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:50.774678 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9f743cf3-b432-400e-8d31-44ebf17dcd4a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.233232 Jun 21 18:27:50.775109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 58/117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:50 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:51.207629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:51.209992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:51.225884 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.229315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.229315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.230211 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.287654 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:51.301706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:51.302316 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:51.314736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.315391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.316280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.316970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.595728 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.605354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ba3a976b-aff4-4161-b51f-2aa353f2360f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.307439 Jun 21 18:27:51.605993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:51 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:51.610864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:51.611630 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:51.619872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.620620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.621613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.622239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.737761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.748672 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-afb7392d-f762-4a1c-9529-38921bbf80b4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.550335 Jun 21 18:27:51.759081 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 60/119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:51 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:51.783457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.791883 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:51.792722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:51.794165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.795815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.797000 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-28bf858c-9aab-4c62-b02c-62e821815cfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.189899 Jun 21 18:27:51.797576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 60/120] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:51 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:51.800813 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.800954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.801612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:51.802114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:51.954738 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:51.963672 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5975899b-c33c-4e15-81a7-1cc75ead3cb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.176315 Jun 21 18:27:51.964250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:51 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:52.623108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:52.623968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:52.630122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.630571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.631339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.631788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.766894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:52.767860 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:52.775366 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.775815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.776853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.777066 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.777822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:52.797288 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3907fb6f-d886-451b-99b0-9f3ae37c4810 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.174925 Jun 21 18:27:52.798795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:52 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:52.823925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:52.824721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:52.831258 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.831834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.832697 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.833462 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.942990 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:52.952311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7196fc1-476c-40d0-82a3-e1edf6155d63 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.190028 Jun 21 18:27:52.955709 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:52 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:52.982622 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:52.984294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:52.984941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:52.991009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.991460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.992074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:52.992209 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:52.993207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:52.995057 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:52.996281 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fc602e32-1ebc-4f83-a368-ec6d10e87c9e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.177505 Jun 21 18:27:52.998396 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 62/124] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:52 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:53.186458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:53.194970 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-05016a6a-3c55-45fa-b011-10e8a19a1b44 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.214524 Jun 21 18:27:53.196426 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:52 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:53.815175 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:53.815783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:53.819982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:53.831322 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:53.832099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:53.833146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:53.840157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:53.959809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-67a0c4f7-5177-416c-98e5-7ffaba5635bc req-7436d041-aba1-4759-aba1-a848de6e89b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f19bd8-9c3f-430a-936a-ff8ca5edfca2", "name": "network-vif-plugged", "status": "completed", "tag": "400961d5-eace-44ab-9e38-40bb8269844d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:53.971188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-67a0c4f7-5177-416c-98e5-7ffaba5635bc req-7436d041-aba1-4759-aba1-a848de6e89b0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:53.974468 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-67a0c4f7-5177-416c-98e5-7ffaba5635bc req-7436d041-aba1-4759-aba1-a848de6e89b0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:53.987835 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-67a0c4f7-5177-416c-98e5-7ffaba5635bc req-7436d041-aba1-4759-aba1-a848de6e89b0 service nova] Creating event network-vif-plugged:400961d5-eace-44ab-9e38-40bb8269844d for instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 on hv-cinder-83124 Jun 21 18:27:53.999842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-67a0c4f7-5177-416c-98e5-7ffaba5635bc req-7436d041-aba1-4759-aba1-a848de6e89b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122437 Jun 21 18:27:54.002048 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 64/126] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:54.014966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:54.019417 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:54.031684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.034213 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.036855 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.037756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.038509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.049233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ccc4e02e-36ea-435a-9af7-08a92259c41d tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.237920 Jun 21 18:27:54.050150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:53 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:54.057647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:54.058775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:54.067289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.067975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.068969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.069564 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.263413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.273208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.275553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.276762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-be4e261f-4f06-4a58-8bd6-4c49b6289eb7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.225354 Jun 21 18:27:54.281822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 64/128] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:54 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:54.288040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:54.290237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:54.299569 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.300620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.301877 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:54.302655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:54.692880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.703572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2c44af3f-ec78-434d-baed-d9421070d384 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.423383 Jun 21 18:27:54.707583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:54 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:54.840468 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:54.848336 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9442aef4-beb2-48cb-a395-5193c22a8df6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.843971 Jun 21 18:27:54.848925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 65/130] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:54 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:55.069299 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:55.070027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:55.078320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.078771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.079797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.080883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.229229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:55.237173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0c3cf44d-b4c6-43b0-a51e-f63ca16d56e5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.171907 Jun 21 18:27:55.237853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:55 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:55.295562 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:55.296195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:55.302392 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.302839 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.303592 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.304026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.452795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:55.461118 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:55.462903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:55.464109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8287b7e5-fcc4-45e7-b7bb-8f5d81274c8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.172619 Jun 21 18:27:55.465019 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 66/132] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:55 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:55.725125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:55.725806 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:55.732728 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.733184 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.733964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.734399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.866474 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:55.867184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:55.877670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.878127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.881083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:55.881083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:55.981475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:55.991299 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-acd7085e-6bd7-4783-8f3b-c8a77383774f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.269561 Jun 21 18:27:55.995991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:55 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:56.033323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-c967d920-f801-4cb5-afb9-697ed052a8cd req-f42064d6-f8b9-4b87-b1a9-5a164c39aa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b830661-c720-48f3-95c1-803626d60a9d", "name": "network-vif-plugged", "status": "completed", "tag": "2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:56.043956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-c967d920-f801-4cb5-afb9-697ed052a8cd req-f42064d6-f8b9-4b87-b1a9-5a164c39aa35 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:56.044699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-c967d920-f801-4cb5-afb9-697ed052a8cd req-f42064d6-f8b9-4b87-b1a9-5a164c39aa35 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:56.060790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-c967d920-f801-4cb5-afb9-697ed052a8cd req-f42064d6-f8b9-4b87-b1a9-5a164c39aa35 service nova] Creating event network-vif-plugged:2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0 for instance 7b830661-c720-48f3-95c1-803626d60a9d on hv-cinder-83124 Jun 21 18:27:56.074627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:56.081042 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-c967d920-f801-4cb5-afb9-697ed052a8cd req-f42064d6-f8b9-4b87-b1a9-5a164c39aa35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051449 Jun 21 18:27:56.085606 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3b2e7aab-428e-4b60-b927-a26ce5d59d79 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.223593 Jun 21 18:27:56.086944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 68/134] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:56.092253 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 67/135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:55 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:56.255658 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:56.256881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:56.270655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:56.270655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:56.270655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:56.270655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:56.483305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:56.485150 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:56.491374 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:56.491928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:56.499192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:56.499192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:56.689164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:56.700790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-74604237-8112-4d2e-8394-389c5f13cf1b tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.449098 Jun 21 18:27:56.701248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 69/136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:56 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:56.702970 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:56.716142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:56.717796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:56.719049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4004fc86-158d-4699-a7da-1df2be65676c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.239884 Jun 21 18:27:56.720444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 68/137] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:56 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:57.010129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:57.010734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:57.016732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.017180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.017943 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.018404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.022606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:27:57.105309 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:57.105920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:57.112301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.113076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.113984 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.114408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.184239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:57.192707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-53dfb1a8-d429-4793-a4fa-ebeae9b76a33 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.187197 Jun 21 18:27:57.194793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 70/138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:57 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:57.382792 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:57.394169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-59f04f7f-4bbf-4c7b-944e-32a7fa8f1b26 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.294443 Jun 21 18:27:57.408010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 69/139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:57 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:57.719447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:57.720077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:57.728014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.728499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.729269 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.729699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.738023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:57.738633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:57.747626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.750803 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:57.753726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:57.754348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.021053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.038315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.048210 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.049687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ec44cc93-446e-4fab-9838-1b58e2ae3d73 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.315267 Jun 21 18:27:58.050097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 70/140] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:57 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:27:58.139801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.149758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d9b67dc9-f25a-453f-9e7b-824e6d79221a tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1314 microversion: 2.1 time: 0.432364 Jun 21 18:27:58.149758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:57 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:58.165410 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b4c54d77-093e-4d39-842c-089dd0129ac8 req-ef94b01c-7a8e-4c10-b216-d1d0df5a4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128ab49-7ea8-40c8-a008-69a7ceac7769", "name": "network-vif-plugged", "status": "completed", "tag": "9ebf45b0-5fbf-431b-85c1-01218c94add8"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:27:58.174297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b4c54d77-093e-4d39-842c-089dd0129ac8 req-ef94b01c-7a8e-4c10-b216-d1d0df5a4be1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:58.178244 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b4c54d77-093e-4d39-842c-089dd0129ac8 req-ef94b01c-7a8e-4c10-b216-d1d0df5a4be1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.188482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b4c54d77-093e-4d39-842c-089dd0129ac8 req-ef94b01c-7a8e-4c10-b216-d1d0df5a4be1 service nova] Creating event network-vif-plugged:9ebf45b0-5fbf-431b-85c1-01218c94add8 for instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 on hv-cinder-83124 Jun 21 18:27:58.196277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b4c54d77-093e-4d39-842c-089dd0129ac8 req-ef94b01c-7a8e-4c10-b216-d1d0df5a4be1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Jun 21 18:27:58.197534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 71/142] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:27:58.213639 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:58.225649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:58.225649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:58.225649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.225649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:58.226038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.395157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.402876 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e251f143-27ec-446f-aa4b-5a217dd79373 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.196935 Jun 21 18:27:58.403454 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:58 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:58.416057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:58.416887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:58.423162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:58.423686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.424594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:58.425124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:58.583507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:58.595709 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-41e5e063-9418-4b9a-89ea-6d364592e1c2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.183976 Jun 21 18:27:58.596533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:58 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:59.068853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:59.069461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:59.077162 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.086298 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.089887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.092875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.168274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:59.169060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:59.179614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.180632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.185535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.186013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.342909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.358347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.364758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.369790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6ae1e951-5211-46d3-b0b7-df96fdd758e9 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.305251 Jun 21 18:27:59.370516 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 73/145] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:27:59 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:27:59.420682 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:59.421537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:59.423989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.432146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.432658 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.433216 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9e216fbf-2f85-4468-b397-2619df64898f tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1502 microversion: 2.1 time: 0.269957 Jun 21 18:27:59.433453 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.434246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.440785 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:59 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:27:59.613982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:59.615015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:27:59.628518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.629357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.630526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:59.631708 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:59.653746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.666532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f0065d3c-8716-4e29-b0e5-3c473ad94bcb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.249794 Jun 21 18:27:59.667871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:59 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:27:59.808817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:27:59.815366 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-38187290-25b0-4813-a883-eb7be1386c2b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.206953 Jun 21 18:27:59.816155 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:27:59 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:00.388958 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:00.389493 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:00.395703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.396149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.397054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.397498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.570578 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:00.585552 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:00.587830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:00.589256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-297e9ee5-c0df-4162-afac-7995c880fb77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.205056 Jun 21 18:28:00.589812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 75/149] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:00 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:00.684137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:00.685417 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:00.695624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.695624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.695624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.695624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.833332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:00.834619 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:00.842074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.842623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.843465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:00.843974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:00.855752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:00.871120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3a17bbce-04a0-4a5f-aef6-819abfa0474b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.191268 Jun 21 18:28:00.871524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:00 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:01.012464 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:01.020450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9e6dace6-79fd-4857-81c1-cfd1031785b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.191138 Jun 21 18:28:01.021036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:00 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:01.610418 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:01.610418 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:01.615271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:01.615727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:01.616539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:01.617038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:01.767571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:01.776855 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:01.778558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:01.779885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7ab79891-8970-4b28-9f62-8ff4f0b8fac0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.175905 Jun 21 18:28:01.780648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 76/152] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:01 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:01.889392 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:01.890044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:01.896488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:01.897006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:01.897713 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:01.898140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.038164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:02.038868 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:02.040164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:02.046450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:02.046688 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.047464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:02.047754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0b5dd110-48fe-4656-b45e-7cde7dc8647d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.162178 Jun 21 18:28:02.047951 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.048600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:01 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:02.189191 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:02.197795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b5afcf3c-0920-4720-bc38-68205f62d8a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.163662 Jun 21 18:28:02.198358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:02 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:02.799095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:02.799712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:02.806805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:02.807262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.808050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:02.808488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.963054 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-adb9f427-70b3-4f4a-b644-c598429ddcf2 req-61cb6037-198d-43e9-9e76-07810833dee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6b7d00-7d63-4188-a97f-783156275509", "name": "network-vif-plugged", "status": "completed", "tag": "06a0d32e-021c-4849-a7d1-7e11d1247848"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:02.973333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-adb9f427-70b3-4f4a-b644-c598429ddcf2 req-61cb6037-198d-43e9-9e76-07810833dee8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:02.973484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:02.973949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-adb9f427-70b3-4f4a-b644-c598429ddcf2 req-61cb6037-198d-43e9-9e76-07810833dee8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:02.983059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:02.984592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:02.989660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d383f573-ee45-4254-9bfd-f0ce96eb378a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.190949 Jun 21 18:28:02.989660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 78/155] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:02 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:02.989998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-adb9f427-70b3-4f4a-b644-c598429ddcf2 req-61cb6037-198d-43e9-9e76-07810833dee8 service nova] Creating event network-vif-plugged:06a0d32e-021c-4849-a7d1-7e11d1247848 for instance db6b7d00-7d63-4188-a97f-783156275509 on hv-cinder-83124 Jun 21 18:28:02.999288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-adb9f427-70b3-4f4a-b644-c598429ddcf2 req-61cb6037-198d-43e9-9e76-07810833dee8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040299 Jun 21 18:28:02.999993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 78/156] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:28:03.068459 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:03.069529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:03.076950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.077799 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:03.084635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.084635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:03.216031 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:03.216833 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:03.221741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:03.223554 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.224009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:03.224823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.225260 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:03.230648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-575a6871-da28-4fda-92b3-488ffe205ac6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.168374 Jun 21 18:28:03.230783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:03.231220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:03 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:03.379123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:03.388817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c34c4adb-98a4-4ab7-b177-1332563f42ca tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.177601 Jun 21 18:28:03.389468 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 79/158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:03 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:03.685311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67602886-a25a-4497-a13d-d4d1b003bc35"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:03.687095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:03.694497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.695183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:03.696451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:03.697201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.004641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:04.005256 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:04.012052 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.012557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.013322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.013752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.148276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:04.156883 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:04.158382 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:04.159479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-21cc640e-814c-49bc-9dcb-b4ab19143fb2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.159130 Jun 21 18:28:04.160037 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 80/159] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:03 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:04.249193 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:04.249804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:04.257400 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.257400 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.257585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.258043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.446626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:04.454784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2c619bcc-be39-4c42-b7c9-2453ed553e14 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1322 microversion: 2.1 time: 0.209703 Jun 21 18:28:04.455357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 81/160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:04 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:04.464682 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:04.465293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:04.471223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.471666 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.472436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:04.472869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:04.627353 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:04.635708 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0c6f3f65-5641-4294-80fb-e05529453d1a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.179128 Jun 21 18:28:04.636293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 82/161] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:04 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:05.016416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-7d0dca34-1895-476f-b5da-6efa488c72dd req-739e46b8-cc61-40c4-820c-edee4fbd755f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "name": "network-vif-plugged", "status": "completed", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:05.024936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7d0dca34-1895-476f-b5da-6efa488c72dd req-739e46b8-cc61-40c4-820c-edee4fbd755f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.025385 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7d0dca34-1895-476f-b5da-6efa488c72dd req-739e46b8-cc61-40c4-820c-edee4fbd755f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.037406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-7d0dca34-1895-476f-b5da-6efa488c72dd req-739e46b8-cc61-40c4-820c-edee4fbd755f service nova] Creating event network-vif-plugged:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:28:05.042557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-7d0dca34-1895-476f-b5da-6efa488c72dd req-739e46b8-cc61-40c4-820c-edee4fbd755f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029942 Jun 21 18:28:05.043160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 83/162] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:28:05.179202 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:05.180018 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:05.188768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.189208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.189966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.190425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.331427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:05.339909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:05.341418 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:05.343228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8c86045b-537b-4384-8fbc-26c4df1341ca tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.167789 Jun 21 18:28:05.343228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 84/163] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:05 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:28:05.473793 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:05.474567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:05.482105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.482383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.483176 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.483615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.667858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:05.676124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bed37f47-fedb-4c1b-a501-7b51b536e826 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1517 microversion: 2.1 time: 0.206227 Jun 21 18:28:05.676840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 85/164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:05 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:05.686642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:05.686642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:05.693718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.693718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.693718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.693718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.846419 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:05.856683 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-18e93fd5-d5f6-41e9-a7bc-e58a1be31191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.178646 Jun 21 18:28:05.857264 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 86/165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:05 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:05.869251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:05.870512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:05.877079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.877526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.878282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:05.878701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:05.942698 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'flavor' on Instance uuid 7128ab49-7ea8-40c8-a008-69a7ceac7769 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:28:06.257335 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-56d41d20-8b5d-4f38-a04c-e8928037a4fc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769/action" status: 200 len: 32 microversion: 2.1 time: 0.391870 Jun 21 18:28:06.257923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 87/166] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:28:05 2022] POST /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:28:06.267291 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:06.267984 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:06.274566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.274997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:06.275754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.276181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:06.410505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:06.418935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-238f98e4-8d0a-4e1d-b12e-e4a07e64b3e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.155658 Jun 21 18:28:06.419503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 88/167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:06 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:06.434542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:06.435421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:06.442432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.443095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:06.444140 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.444794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:06.688567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:06.699217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:06.701156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:06.702397 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d840237b-aa06-4a09-953b-2a08ee238555 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.272690 Jun 21 18:28:06.704312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 89/168] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:06 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:06.874403 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:06.875007 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:06.890020 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.890427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:06.891977 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:06.892543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:07.037346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:07.045563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cfecfa69-c776-455c-a3a6-49069112895f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.175366 Jun 21 18:28:07.046153 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 90/169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:06 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:07.434565 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-19f0c2a2-dfb6-4b14-96d6-7513d7220aa7 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "POST /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.754852 Jun 21 18:28:07.435443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 80/170] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:28:03 2022] POST /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2/os-volume_attachments => generated 194 bytes in 3757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:28:07.437938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:07.437938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:07.441041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:07.444540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:07.444996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:07.445915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:07.446245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:07.587538 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:07.596852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e51c6983-6ecd-403d-9868-d79215e026f7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.164176 Jun 21 18:28:07.597798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 91/171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:07 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:07.722968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:07.723672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:07.725681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=95 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:07.731087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:07.731546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:07.732334 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:07.732796 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:07.889074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:07.898842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:07.900686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:07.901859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-169bfbe3-223b-4c2a-885c-5e169f194d69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.183700 Jun 21 18:28:07.906971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 81/172] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:07 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:08.064137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:08.064786 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:08.071158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.071607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:08.072378 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.072846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:08.237735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:08.246067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-198a052e-d4a6-4ff7-9966-b6054d4a44cb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.185831 Jun 21 18:28:08.246649 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 92/173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:08 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:08.614908 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:08.615543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:08.621810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.622277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:08.622976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.623413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:08.757618 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:08.766209 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a4ca9f41-917b-4872-83bc-bceac55e364b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.155500 Jun 21 18:28:08.766788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 82/174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:08 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:08.921543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:08.922153 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:08.928237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.928712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:08.929464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:08.929919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:09.115166 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:09.123145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:09.124998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:09.126125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9cbf750e-d31f-419c-91b0-356c6a872145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.209035 Jun 21 18:28:09.126673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 93/175] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:08 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:09.267438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:09.270628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:09.278458 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:09.278927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:09.279688 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:09.281015 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:09.450600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:09.461161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7c9d1942-47ae-4023-8916-ff7933b98332 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.200990 Jun 21 18:28:09.461935 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 83/176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:09 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:09.783643 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:09.784342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:09.790447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:09.790890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:09.791659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:09.792084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:09.815625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:09.941714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:09.950008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dcd2fc70-b9c9-46c1-8b80-d0af41cbd963 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.170207 Jun 21 18:28:09.950643 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 94/177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:09 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:10.143548 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:10.144161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:10.151274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.151720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.153091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.153576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.338971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:10.347980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:10.349538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:10.350651 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8a8920f3-5482-4707-ba42-29395b3b1291 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.211155 Jun 21 18:28:10.351219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 84/178] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:10 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:10.477547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:10.478165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:10.485741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.486188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.486952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.487533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.683447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:10.700469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-762eb691-8e45-4766-9dc5-3ff4115d0d70 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.226728 Jun 21 18:28:10.708796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 95/179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:10 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:10.967980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:10.968581 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:10.975094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.975554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.976325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:10.976793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:10.996871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:11.117996 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:11.125825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5f57307e-084a-4e14-a73d-2755b2e70ce4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.162528 Jun 21 18:28:11.126408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 85/180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:10 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:11.369608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:11.370223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:11.376948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:11.377401 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:11.378171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:11.378610 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:11.511850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:11.524918 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:11.526423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:11.528557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-11ffad1a-fc2f-4155-8a75-60bc93efeddf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.162616 Jun 21 18:28:11.529121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 96/181] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:11 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:11.717954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:11.718563 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:11.727546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:11.727993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:11.728833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:11.729310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:11.876364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:11.884070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7ac1970f-d77b-4e64-93a2-27dc881b5af6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.170322 Jun 21 18:28:11.884710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 86/182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:11 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:12.146369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:12.146980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:12.154051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.154501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:12.155288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.155718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:12.298684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:12.307004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-32398105-5d02-4f9c-8e5d-3b28afee035c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.165113 Jun 21 18:28:12.307603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 97/183] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:12 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:12.545622 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:12.546226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:12.552186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.552665 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:12.553427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.553852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:12.689906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:12.700298 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:12.701908 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:12.708691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bede9083-e3b7-4e75-8e81-6664eccecbe4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.161483 Jun 21 18:28:12.708691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 87/184] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:12 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:12.901091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:12.901738 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:12.909070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.909070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:12.909369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:12.909549 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.051789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:13.059752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-043439b1-06ed-4aec-a194-b84a6d1cf7a5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1366 microversion: 2.1 time: 0.162534 Jun 21 18:28:13.063511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 98/185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:12 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:13.324777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:13.325442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:13.332029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.332506 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.333270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.333703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.466944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:13.474525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-28ddcdc9-97c3-48b1-ac8a-366d8162fd53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.154406 Jun 21 18:28:13.477988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 88/186] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:13 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:13.722075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:13.722635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:13.729174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.729828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.731718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.732152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.944960 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:13.954652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:13.956285 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:13.957537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d92df130-08a0-4c94-bc48-b03ed58ce489 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.239817 Jun 21 18:28:13.958136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 99/187] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:13 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:28:14.085256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:14.086148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:14.097146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.097844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.099203 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.108165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.337125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:14.359032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dbe95634-bdf5-469b-acb7-5948762f1714 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1556 microversion: 2.1 time: 0.285984 Jun 21 18:28:14.361215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 89/188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:14 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1556 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:14.398600 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:14.409608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:14.433929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.434567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.435444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.436145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.501105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:14.504435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:14.523729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.524775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.526657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.528053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.632314 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4c8b1c69-5020-4c8f-9d65-6ba47f9e436b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243499 Jun 21 18:28:14.639241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 100/189] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:28:14 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:28:14.941379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:14.953649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-07e26ad2-88d7-4573-ad43-6a877338c232 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.463632 Jun 21 18:28:14.954787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 90/190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:14 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:14.980158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:14.982089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:14.999464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.999464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.999464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.999464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:15.229863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:15.241837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:15.256781 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:15.256781 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fe7c41c0-bf07-4211-ba3a-ccf94692e24f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1407 microversion: 2.20 time: 0.272191 Jun 21 18:28:15.257772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 101/191] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:14 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:28:15.971828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:15.972779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:15.983298 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:15.984118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:15.985347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:15.986195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:16.272891 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:16.275483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:16.290637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:16.294383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:16.299867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:16.301114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:16.431632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:16.453588 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-176d43f3-1098-4e78-b86c-41785aae9107 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.485699 Jun 21 18:28:16.456560 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 91/192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:15 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:16.525505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:16.528582 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:16.530102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:16.531293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f00fe26b-5ca6-479e-b103-c84dfe7b38f8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1600 microversion: 2.20 time: 0.265852 Jun 21 18:28:16.532446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 102/193] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:28:16 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:16.570266 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:16.570643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:16.592934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:16.593963 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:16.594757 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:16.597836 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:16.797333 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8eb205d5-861b-40ec-8702-e740ea1ec1fe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.237874 Jun 21 18:28:16.808854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 92/194] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jun 21 18:28:16 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:28:17.056827 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-98ca6574-8939-497e-8200-a80801d3d528 req-7f7bdb37-280d-4cdf-a31f-f112d4fe8497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6b7d00-7d63-4188-a97f-783156275509", "tag": "06a0d32e-021c-4849-a7d1-7e11d1247848"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:17.068274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-98ca6574-8939-497e-8200-a80801d3d528 req-7f7bdb37-280d-4cdf-a31f-f112d4fe8497 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:17.068740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-98ca6574-8939-497e-8200-a80801d3d528 req-7f7bdb37-280d-4cdf-a31f-f112d4fe8497 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:17.094638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-98ca6574-8939-497e-8200-a80801d3d528 req-7f7bdb37-280d-4cdf-a31f-f112d4fe8497 service nova] Creating event network-changed:06a0d32e-021c-4849-a7d1-7e11d1247848 for instance db6b7d00-7d63-4188-a97f-783156275509 on hv-cinder-83124 Jun 21 18:28:17.119023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-98ca6574-8939-497e-8200-a80801d3d528 req-7f7bdb37-280d-4cdf-a31f-f112d4fe8497 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065906 Jun 21 18:28:17.119820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 103/195] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:28:17.479315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:17.481786 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:17.490427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:17.491578 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:17.492770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:17.493330 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:17.777473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:17.794048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ac13a6f2-b4f1-41d8-b793-5d081819ae12 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.319410 Jun 21 18:28:17.795669 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 93/196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:17 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:18.812528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:18.814019 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:18.820888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:18.821337 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:18.822159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:18.822591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:19.173987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:19.188778 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9f181aa0-e9d9-4428-88d5-c83681d6a31a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.380841 Jun 21 18:28:19.190973 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 104/197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:18 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:19.906411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b7baf4d5-f3e8-4f37-a9ec-b6c65b70d876 req-fd48b819-d3ae-4bc9-8b1e-6d593dc34152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:19.928002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b7baf4d5-f3e8-4f37-a9ec-b6c65b70d876 req-fd48b819-d3ae-4bc9-8b1e-6d593dc34152 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:19.929606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b7baf4d5-f3e8-4f37-a9ec-b6c65b70d876 req-fd48b819-d3ae-4bc9-8b1e-6d593dc34152 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:19.955646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b7baf4d5-f3e8-4f37-a9ec-b6c65b70d876 req-fd48b819-d3ae-4bc9-8b1e-6d593dc34152 service nova] Creating event network-changed:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:28:20.005176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b7baf4d5-f3e8-4f37-a9ec-b6c65b70d876 req-fd48b819-d3ae-4bc9-8b1e-6d593dc34152 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092269 Jun 21 18:28:20.010346 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 94/198] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:28:20.211217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:20.215012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:20.245262 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:20.249750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:20.250995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:20.251610 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:20.652907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:20.666273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f3d6a728-3fe7-4345-a30f-b76e3bc1a3d4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.463367 Jun 21 18:28:20.667229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 105/199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:20 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:21.688032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:21.688808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:21.698413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:21.699456 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:21.701036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:21.701036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:21.915636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:21.934311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-adf33446-061e-490b-97dc-cd0fc1b55685 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.251006 Jun 21 18:28:21.947528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 95/200] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:21 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:22.955341 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:22.955999 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:22.962424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:22.962872 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:22.963629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:22.964061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:23.121089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:23.129719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-89772716-f885-4f91-9511-d9050126011e tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.178960 Jun 21 18:28:23.132800 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 106/201] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:22 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:24.146921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:24.147735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:24.155981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:24.158073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:24.158073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:24.158073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:24.307450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:24.316034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-78e061e4-3c51-454e-b7c4-025e1a3a8b53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.173138 Jun 21 18:28:24.316740 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 96/202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:24 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:25.334234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:25.334836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:25.341647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:25.342589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:25.343533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:25.344141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:25.520143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:25.530082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1aa4727d-61fd-47c9-ae15-3e74c5ebbf22 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.199693 Jun 21 18:28:25.530673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 107/203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:25 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:26.306278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:26.306954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:26.313679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.314132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.314905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.315339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.343895 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:28:26.548971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:26.549578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:26.556489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.563691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.563691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.563691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.619310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-22481037-2558-4ed3-ab74-fe2e8b1cf4fe tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 204 len: 0 microversion: 2.1 time: 0.316247 Jun 21 18:28:26.620403 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 97/204] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:28:26 2022] DELETE /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:28:26.630839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:26.631804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:26.641690 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.642212 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.643546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:26.643631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:26.710622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:26.721733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-41155bb7-d157-4749-8908-07323715fc47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.176501 Jun 21 18:28:26.723885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 108/205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:26 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:26.819102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:26.829715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b0f98a66-713d-4da6-b7f3-7afb00f49d05 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.203837 Jun 21 18:28:26.830305 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 98/206] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:26 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:27.748267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:27.748916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:27.756143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:27.756628 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:27.757397 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:27.757832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:27.854992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:27.855708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:27.862495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:27.862947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:27.863723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:27.864333 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:27.913325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:27.924843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c3474618-cddc-4e7a-b5a1-cf810fc2e5de tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.180525 Jun 21 18:28:27.925584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 109/207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:27 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:28.025097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:28.025097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a86b7385-8993-4050-96ae-f18be8761a4c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.164421 Jun 21 18:28:28.025097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 99/208] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:27 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:28.942119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:28.942754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:28.949053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:28.949502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:28.950261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:28.950700 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:29.040914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:29.041532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:29.049155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:29.049609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:29.050463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:29.050893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:29.086784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:29.096626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-32d0beb5-ce0a-4c61-b868-4c191c70e055 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.158203 Jun 21 18:28:29.097217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:28 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:29.185487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:29.195332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-893a4090-14b5-4f77-8659-a416cf6c92da tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.158342 Jun 21 18:28:29.195951 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:29 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:30.114195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:30.114852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:30.121984 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:30.122429 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:30.123196 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:30.123626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:30.212022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:30.212664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:30.219378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:30.219759 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:30.221124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:30.221124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:30.241534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:30.254445 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:30.262266 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-13d13972-2ffe-48a6-8164-25aee09cfde8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.151891 Jun 21 18:28:30.262861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 111/211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:30 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:30.349782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:30.358848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2494c7e8-9989-4610-aff5-bd74ab9af3f5 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.150576 Jun 21 18:28:30.359426 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 101/212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:30 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:31.279476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:31.280092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:31.286455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:31.286892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:31.287656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:31.288085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:31.292653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:31.377076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:31.377688 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:31.384091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:31.384578 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:31.385382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:31.385867 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:31.425905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:31.434664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-883c0074-31ae-4e8d-bdf0-4ed5cf3cc450 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.159189 Jun 21 18:28:31.435252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 112/213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:31 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:31.523811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:31.532356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7b317369-0e82-4d7c-af54-33e612cff719 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.159997 Jun 21 18:28:31.534920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 102/214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:31 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:32.451691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:32.452254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:32.458553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:32.459012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:32.459951 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:32.460453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:32.550736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:32.551564 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:32.558818 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:32.559272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:32.560068 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:32.560554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:32.595844 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:32.603625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e7a7633a-3e2e-4429-9d8a-504c2a6e2a3a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.156451 Jun 21 18:28:32.604275 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 113/215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:32 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:32.772689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:32.794919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1b10a83c-4493-44c5-b4ae-8f191d5e5c55 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1554 microversion: 2.1 time: 0.248084 Jun 21 18:28:32.796226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 103/216] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:32 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:33.206237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1924681870", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "networks": [{"uuid": "94d63e97-3d02-4417-a35f-f6916d4c6d76"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:33.286772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] validate_networks() for [('94d63e97-3d02-4417-a35f-f6916d4c6d76', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:28:33.578894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-9b27e418-9eef-4fdd-be82-900218d1b7f9 req-807b3e16-2e79-484c-afce-c82719e4e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f19bd8-9c3f-430a-936a-ff8ca5edfca2", "name": "network-vif-deleted", "tag": "400961d5-eace-44ab-9e38-40bb8269844d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:33.590706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-9b27e418-9eef-4fdd-be82-900218d1b7f9 req-807b3e16-2e79-484c-afce-c82719e4e5e1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.591384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-9b27e418-9eef-4fdd-be82-900218d1b7f9 req-807b3e16-2e79-484c-afce-c82719e4e5e1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.604203 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-9b27e418-9eef-4fdd-be82-900218d1b7f9 req-807b3e16-2e79-484c-afce-c82719e4e5e1 service nova] Creating event network-vif-deleted:400961d5-eace-44ab-9e38-40bb8269844d for instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 on hv-cinder-83124 Jun 21 18:28:33.610089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-9b27e418-9eef-4fdd-be82-900218d1b7f9 req-807b3e16-2e79-484c-afce-c82719e4e5e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035247 Jun 21 18:28:33.610710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 104/217] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:28:33.626386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:33.627092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:33.634364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.634789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.635793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.637211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.715078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:28:33.716428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:28:33.716902 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:28:33.717663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:28:33.718551 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:28:33.731245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.731886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.733356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.737099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.757569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Getting quotas for project 444a0fac8c834c3cab5ba1df5a261aac. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:28:33.768920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Getting quotas for user b6bbd45ee6964c4986f3c778ab8ad231 and project 444a0fac8c834c3cab5ba1df5a261aac. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:28:33.775984 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:28:33.779061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:28:33.798183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:33.806900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3890aaeb-45ce-451a-b377-70cf74be8281 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.188939 Jun 21 18:28:33.808432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 105/218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:33 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:33.813509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:33.814425 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:33.820630 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.821081 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.821848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:33.822287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:33.886702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:33.895379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-71fd3674-a331-4303-b071-441800edb79c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1345 microversion: 2.1 time: 0.085900 Jun 21 18:28:33.896102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 106/219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:33 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:33.919231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b127ff63-68c1-4e3b-8ea3-731a0c52bdd8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716745 Jun 21 18:28:33.919895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 114/220] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:28:33.930189 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-085d41d1-a69d-4a9d-be13-a91d0c20cccb tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:33.930870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-085d41d1-a69d-4a9d-be13-a91d0c20cccb tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:33.991232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-085d41d1-a69d-4a9d-be13-a91d0c20cccb tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:33.999850 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-085d41d1-a69d-4a9d-be13-a91d0c20cccb tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1214 microversion: 2.1 time: 0.073566 Jun 21 18:28:34.000602 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 107/221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:33 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:34.826357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:34.827324 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:34.834103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:34.834516 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:34.835310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:34.835727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:34.912852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:34.913562 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:34.922147 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:34.927005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:34.927005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:34.927005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:34.962760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:34.963246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:34.963747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lazy-loading 'fault' on Instance uuid e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:28:35.011485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:35.020474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-48c69cd4-0bd7-4970-98d9-d14395e1d11c tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1350 microversion: 2.1 time: 0.111078 Jun 21 18:28:35.021150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 108/222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:34 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:35.027101 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-63c21331-22af-4b96-a365-965c08d24058 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:35.028230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-63c21331-22af-4b96-a365-965c08d24058 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:35.051991 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:35.060487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-578517e3-6e73-494a-bb71-2a2e34f306ac tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.238995 Jun 21 18:28:35.061427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 115/223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:34 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:35.081375 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-63c21331-22af-4b96-a365-965c08d24058 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:35.089967 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-63c21331-22af-4b96-a365-965c08d24058 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1214 microversion: 2.1 time: 0.066994 Jun 21 18:28:35.090647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 109/224] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:35 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:36.039225 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:36.040016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:36.048017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.048572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.049443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.050021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.078792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:36.079425 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:36.083239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.083760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.084288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lazy-loading 'fault' on Instance uuid e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:28:36.086332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.086784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.087550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.087979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.137329 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:36.145836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b26c7e9-0138-415c-86bd-b7242e5132ad tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1350 microversion: 2.1 time: 0.110935 Jun 21 18:28:36.146507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 116/225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:36 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:36.151150 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:36.152651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:36.159180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.159854 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.160673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:36.161103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:36.222589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:36.231713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c564724f-b2c5-4063-bee7-a4a7396156ac tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1218 microversion: 2.1 time: 0.084097 Jun 21 18:28:36.232626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:36 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:36.250090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:36.258112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-163c1afb-856d-4aac-a90c-f98cd8368309 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.183676 Jun 21 18:28:36.259152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 110/227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:36 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:37.162902 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:37.163519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:37.169684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.170132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.170901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.171337 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.202761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.203213 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.203661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lazy-loading 'fault' on Instance uuid e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:28:37.244652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d70344216248199ddf81fba88af04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5e18f0b6ab45ef961c14b967941ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:37.249594 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:37.250372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:37.253169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f0a6639c-b80a-40d6-86b6-be442394d386 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 200 len: 1350 microversion: 2.1 time: 0.094039 Jun 21 18:28:37.253754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 118/228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:37 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:37.258083 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.258725 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.259498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.259937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.275229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:37.275921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:37.283053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.283737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.284630 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:37.285140 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:37.355595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:37.363384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5c75d39b-29ab-4d7f-9094-55849fd04904 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1218 microversion: 2.1 time: 0.118130 Jun 21 18:28:37.364377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 111/229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:37 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:37.450567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:37.458521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4e8b2e97-d68c-445e-977b-e80434970bb3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.187339 Jun 21 18:28:37.459404 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 119/230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:37 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:38.269864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:38.270477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:38.272922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:38.278751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.279250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.280015 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.280477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.295253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] HTTP exception thrown: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Request method failure captured: Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 HTTP/1.1 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2CBmqV3BNPfjqCF6Z0wyVRo3Umq5itp9UKGvlBVtxlSpuO1vwOneFkWzsBfD8yLDdjV4591dwX53Zb15JCvteWKqLvcoMgIMx_trW-ro3ZQyyI4i0JlBgxycA86URMJdSlP2tv0HeX8SMM8gmQCyxTnHDwyu8SxAo4EVOApkpuS48 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:28:38.308512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 35d70344216248199ddf81fba88af04f Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.310041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'e9f19bd8-9c3f-430a-936a-ff8ca5edfca2'} Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:28:38.310980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.312313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.313582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Returning 404 to user: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:28:38.313582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8c421084-b512-4dc6-9ef7-84c8358e6906 tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 404 len: 111 microversion: 2.1 time: 0.044261 Jun 21 18:28:38.313582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 112/231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:38 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:28:38.381304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:38.382006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:38.383938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:38.405933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.405933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.405933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.405933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.480668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:38.482006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:38.487739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:38.489129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.489583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.490423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.490859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.497599 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ae355a04-3d3d-4720-b9d4-61f0887910af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1266 microversion: 2.1 time: 0.120260 Jun 21 18:28:38.498706 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 120/232] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:38 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:38.504281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:38.505534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:38.518958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.524473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.524473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:38.524473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:38.539720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] HTTP exception thrown: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Request method failure captured: Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2/os-volume_attachments HTTP/1.1 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2CBmqV3BNPfjqCF6Z0wyVRo3Umq5itp9UKGvlBVtxlSpuO1vwOneFkWzsBfD8yLDdjV4591dwX53Zb15JCvteWKqLvcoMgIMx_trW-ro3ZQyyI4i0JlBgxycA86URMJdSlP2tv0HeX8SMM8gmQCyxTnHDwyu8SxAo4EVOApkpuS48 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:28:38.550925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 35d70344216248199ddf81fba88af04f Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.552201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'server_id': 'e9f19bd8-9c3f-430a-936a-ff8ca5edfca2'} Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:28:38.552961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:38.554125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:28:38.555881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Returning 404 to user: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:28:38.555881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-210b5fc1-58a6-4ff9-b8f5-36f0eb1cc8be tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052171 Jun 21 18:28:38.555881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 121/233] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:28:38 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:28:38.834864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:38.842537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8e52f10c-6863-4fe2-9623-423d70f46f65 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.368689 Jun 21 18:28:38.843105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 113/234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:38 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:39.517326 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:39.523975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:39.534133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:39.534133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:39.542995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:39.542995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:39.728273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:39.739082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e5fe757-df0d-496a-a37c-5986c123fb66 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.226876 Jun 21 18:28:39.748020 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 122/235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:39 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:39.866885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:39.876515 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:39.880509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:39.880993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:39.881922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:39.882579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:40.120995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:40.129483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d91be442-1d94-4afc-a59a-e8e2caf82c2d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.267652 Jun 21 18:28:40.130116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 114/236] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:39 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:40.661977 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ee38b655-3d79-4eff-b34e-1fb7b886419e req-ddec3b48-2624-486d-a8bd-1026e91267ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe21569-881a-476d-93e9-0b8d0af9fc52", "tag": "e6bb3e1a-a073-4e95-803b-19493bb8bdb9"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:40.670656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ee38b655-3d79-4eff-b34e-1fb7b886419e req-ddec3b48-2624-486d-a8bd-1026e91267ec service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:40.671255 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ee38b655-3d79-4eff-b34e-1fb7b886419e req-ddec3b48-2624-486d-a8bd-1026e91267ec service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:40.684926 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ee38b655-3d79-4eff-b34e-1fb7b886419e req-ddec3b48-2624-486d-a8bd-1026e91267ec service nova] Creating event network-changed:e6bb3e1a-a073-4e95-803b-19493bb8bdb9 for instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 on hv-cinder-83124 Jun 21 18:28:40.689212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ee38b655-3d79-4eff-b34e-1fb7b886419e req-ddec3b48-2624-486d-a8bd-1026e91267ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Jun 21 18:28:40.689810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 123/237] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:28:40.760011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:40.761313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:40.767738 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:40.768193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:40.768997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:40.769432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:40.990332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:41.000980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-60d66d39-b938-4e24-aa5f-22bb16647d3c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.245812 Jun 21 18:28:41.001568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 115/238] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:40 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:41.147121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:41.150271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:41.154498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.154943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.155719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.156152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.219643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:41.220046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:41.230474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.231206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.232155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.232865 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.253224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] HTTP exception thrown: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Request method failure captured: Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 HTTP/1.1 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2CBmqV3BNPfjqCF6Z0wyVRo3Umq5itp9UKGvlBVtxlSpuO1vwOneFkWzsBfD8yLDdjV4591dwX53Zb15JCvteWKqLvcoMgIMx_trW-ro3ZQyyI4i0JlBgxycA86URMJdSlP2tv0HeX8SMM8gmQCyxTnHDwyu8SxAo4EVOApkpuS48 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:28:41.256730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 35d70344216248199ddf81fba88af04f Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.258343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'e9f19bd8-9c3f-430a-936a-ff8ca5edfca2'} Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:28:41.259158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.260635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.263017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Returning 404 to user: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:28:41.263902 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-86721577-0d49-40fe-b0e9-b15496faeb0e tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 404 len: 111 microversion: 2.1 time: 0.049228 Jun 21 18:28:41.264595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 116/239] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:28:41 2022] DELETE /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:28:41.275430 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:41.276041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] [instance: e9f19bd8-9c3f-430a-936a-ff8ca5edfca2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:41.283842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.284306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.285167 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:41.285612 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:41.300767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] HTTP exception thrown: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Request method failure captured: Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 HTTP/1.1 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2CBmqV3BNPfjqCF6Z0wyVRo3Umq5itp9UKGvlBVtxlSpuO1vwOneFkWzsBfD8yLDdjV4591dwX53Zb15JCvteWKqLvcoMgIMx_trW-ro3ZQyyI4i0JlBgxycA86URMJdSlP2tv0HeX8SMM8gmQCyxTnHDwyu8SxAo4EVOApkpuS48 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:28:41.302411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7e5e18f0b6ab45ef961c14b967941ca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 7e5e18f0b6ab45ef961c14b967941ca6 Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-DeleteServersTestJSON-125214828 Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 35d70344216248199ddf81fba88af04f Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-DeleteServersTestJSON-125214828-project Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.303739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'e9f19bd8-9c3f-430a-936a-ff8ca5edfca2'} Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:28:41.308801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. Jun 21 18:28:41.310197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:28:41.311521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] Returning 404 to user: Instance e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:28:41.311521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0b317cff-a8b6-4d72-b9b8-46339bdde4ea tempest-DeleteServersTestJSON-125214828 tempest-DeleteServersTestJSON-125214828-project] 10.222.0.23 "GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2" status: 404 len: 111 microversion: 2.1 time: 0.032386 Jun 21 18:28:41.311521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 117/240] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:41 2022] GET /compute/v2.1/servers/e9f19bd8-9c3f-430a-936a-ff8ca5edfca2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:28:41.357142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:41.365148 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a54d7c30-2ea0-4ae4-b86c-ab1bfb2c741d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.222163 Jun 21 18:28:41.365809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:41 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:42.018902 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:42.019470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:42.027028 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:42.027481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:42.028270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:42.028740 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:42.382376 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:42.382988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:42.387745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:42.389768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:42.390220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:42.390999 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:42.391437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:42.397481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6c4caab0-fa3d-46c2-bacb-b3430a942718 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.381239 Jun 21 18:28:42.400662 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 118/242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:42 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:42.552216 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:42.562421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-24ecfc54-c132-465c-8851-e661c29e181d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.183773 Jun 21 18:28:42.563026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 125/243] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:42 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:43.416568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:43.418499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:43.437966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:43.438608 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:43.446938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:43.446938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:43.581158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:43.582892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:43.593722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:43.594252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:43.594979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:43.600012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:43.628436 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:43.642644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a5f2c8af-8744-46ba-ba82-ce922eb2ba15 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.230342 Jun 21 18:28:43.646270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 119/244] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:43 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:43.744680 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:43.772529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:43.802139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:43.812087 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-de70cbf4-33c3-4206-9954-8bfa3e1e5969 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.235427 Jun 21 18:28:43.813002 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 126/245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:43 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:44.663180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:44.663770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:44.671539 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:44.671987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:44.672788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:44.673313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:44.827962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:44.827962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2f1dd99b-18cd-49eb-8b97-dddfbf2c0977 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.167786 Jun 21 18:28:44.828339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 120/246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:44 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:44.829584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:44.830299 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:44.837829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:44.838362 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:44.839739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:44.840257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:45.010537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:45.019866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a03ffca1-36da-494c-8a21-277bc8c01ed6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.194303 Jun 21 18:28:45.020674 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 127/247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:44 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:45.850065 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:45.850710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:45.867284 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:45.878719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:45.879186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:45.880174 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:45.880624 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:46.037398 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:46.038116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:46.046331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:46.047055 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:46.048194 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:46.048887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:46.203820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:46.218833 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d4a1d83d-be41-4eea-bc9b-8e538f216392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.185166 Jun 21 18:28:46.231571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 128/248] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:46 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:46.303239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:46.314400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1075f6da-b111-4673-9aea-c128042b8f59 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.472458 Jun 21 18:28:46.321767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 121/249] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:45 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:47.236972 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:47.238318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:47.245033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:47.246150 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:47.247439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:47.248136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:47.345631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:47.345631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:47.361250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:47.362874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:47.366775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:47.380229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:47.396356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:47.454182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:47.467434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-572b973f-d3ee-4912-a19b-d7df77aab392 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.234073 Jun 21 18:28:47.468011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 129/250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:47 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:47.582841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:47.601350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0befc22f-0e4e-4318-9bfd-762dd8c19a30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.256633 Jun 21 18:28:47.601350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 122/251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:47 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:48.485845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:48.486577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:48.492894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:48.493346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:48.494116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:48.494557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:48.499019 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:28:48.621312 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:48.622976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:48.633675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:48.634336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:48.636465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:48.637406 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:48.645847 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:48.654584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3f817e0d-d290-4f25-b9d9-cd407b1cbeba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1523 microversion: 2.1 time: 0.172604 Jun 21 18:28:48.655169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 130/252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:48 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:48.806102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:48.815412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d697d1da-ebcc-4a34-8443-6ffdcf829671 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.200350 Jun 21 18:28:48.815997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 123/253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:48 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:49.673205 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:49.674815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:49.683064 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.683887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:49.684802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.685228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:49.833089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:49.834069 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:49.837475 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:49.841805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.842884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:49.843771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.844722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:49.847128 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa96e038-ccc7-4095-aa32-037ef0a38744 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1503 microversion: 2.1 time: 0.178810 Jun 21 18:28:49.855280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 131/254] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:49 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:49.871925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:49.876652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:49.889530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.890045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:49.890865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:49.891303 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:50.009275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:50.017480 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ded914b7-7e27-47b1-8af3-20093ac133a1 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.188562 Jun 21 18:28:50.018094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 124/255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:49 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:50.048125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:50.056130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8db10d58-b4e4-4fdc-9d6a-b4fd528e0e08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1516 microversion: 2.1 time: 0.189867 Jun 21 18:28:50.056741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 132/256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:49 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:51.035829 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:51.036644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:51.044555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:51.045011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:51.046020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:51.046491 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:51.116878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-3213f8fb-884d-4b94-8905-4d7af5808942 req-b65d84ae-97de-46d2-85e1-b62b06679eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe21569-881a-476d-93e9-0b8d0af9fc52", "name": "network-vif-plugged", "status": "completed", "tag": "e6bb3e1a-a073-4e95-803b-19493bb8bdb9"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:51.139809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-3213f8fb-884d-4b94-8905-4d7af5808942 req-b65d84ae-97de-46d2-85e1-b62b06679eb4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:51.140248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-3213f8fb-884d-4b94-8905-4d7af5808942 req-b65d84ae-97de-46d2-85e1-b62b06679eb4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:51.158094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-3213f8fb-884d-4b94-8905-4d7af5808942 req-b65d84ae-97de-46d2-85e1-b62b06679eb4 service nova] Creating event network-vif-plugged:e6bb3e1a-a073-4e95-803b-19493bb8bdb9 for instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 on hv-cinder-83124 Jun 21 18:28:51.163880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-3213f8fb-884d-4b94-8905-4d7af5808942 req-b65d84ae-97de-46d2-85e1-b62b06679eb4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054641 Jun 21 18:28:51.164645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 133/257] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:28:51.203663 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:51.213104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5e61d954-f78f-4898-9fe7-e496c40b5e8e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.181546 Jun 21 18:28:51.213981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:51 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:52.241981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:52.242754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:52.250377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.251005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.252427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.252745 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.253467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:28:52.255049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:52.264732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.265323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.266100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.266525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.298470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'flavor' on Instance uuid 7b830661-c720-48f3-95c1-803626d60a9d {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:28:52.391538 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:52.399633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c6bde028-b6d2-41c4-ae95-c4f4618407bf tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1314 microversion: 2.1 time: 0.161866 Jun 21 18:28:52.400350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 134/259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:52 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:52.697368 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4f8d4192-3add-4abe-a0af-9eff8f5ae97d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/action" status: 200 len: 32 microversion: 2.1 time: 0.452641 Jun 21 18:28:52.705550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 126/260] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:28:52 2022] POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:28:52.714673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:52.715690 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:52.722256 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.722796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.723608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:52.724107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:52.875039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:52.888277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f6745c08-41b4-4640-ac48-7407ac1287f5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.178534 Jun 21 18:28:52.888956 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 135/261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:52 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:53.420647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:53.421627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:53.435762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:53.443585 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:53.443585 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:53.443585 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:53.594913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:53.604841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-34c0e95d-4201-40d9-8b0e-d9667a11a839 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1498 microversion: 2.1 time: 0.189737 Jun 21 18:28:53.616550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 127/262] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:53 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:53.908289 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:53.909864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:53.926070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:53.926070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:53.927355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:53.928016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:54.103653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:54.109688 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eb24393e-07c0-4bbe-82a7-d7ab7ca693d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.206954 Jun 21 18:28:54.110455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 136/263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:53 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:54.944854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:54.945352 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:54.953251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:54.955093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:54.955093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:54.955093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:54.982166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:28:55.127790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:55.128316 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:55.139876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:55.140501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:55.141358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:55.141864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:55.264621 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9f81cb04-eac2-46e5-a105-f5695a5157c3 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 204 len: 0 microversion: 2.1 time: 0.323146 Jun 21 18:28:55.266834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:28:54 2022] DELETE /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:28:55.274061 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:55.274877 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:55.281750 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:55.282203 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:55.282973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:55.283408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:55.283760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:55.291558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e5e76ff2-a7bf-445e-9383-b917886817a2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.168198 Jun 21 18:28:55.292328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 137/265] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:55 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:55.463098 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:55.470128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b73cdabb-4de3-46a9-b1d1-479471c7974f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1504 microversion: 2.1 time: 0.200314 Jun 21 18:28:55.470730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 129/266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:55 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:56.309606 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:56.310264 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:56.317058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:56.317554 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:56.318514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:56.318947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:56.465195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:56.473487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a147b641-af18-45f2-bc9c-9ce259aaf4b9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.167890 Jun 21 18:28:56.476539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 138/267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:56 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:56.488524 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:56.489135 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:56.496456 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:56.496936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:56.497779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:56.498223 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:56.674909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:56.683382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d2fa80bb-7f0e-43b4-af18-26f84b845d5a tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1504 microversion: 2.1 time: 0.198700 Jun 21 18:28:56.683973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 130/268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:56 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:57.497362 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:57.498044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:57.505607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:57.506052 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:57.506896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:57.507425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:57.674242 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:57.688707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-99310f6b-192c-416e-a58c-9b71266b417f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.200671 Jun 21 18:28:57.690929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 139/269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:57 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:57.703730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:57.704584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:57.713837 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:57.714290 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:57.715986 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:57.716927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:58.109898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:58.119465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d829bbb4-1d40-46b7-bbc0-6e5ce8dbe3f5 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1504 microversion: 2.1 time: 0.422122 Jun 21 18:28:58.120218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:57 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:28:58.720107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:58.721344 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:58.732128 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:58.733017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:58.734355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:58.735334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:58.905302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:58.913828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4ae61e53-e73c-4abd-80b8-bb987da02814 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.200654 Jun 21 18:28:58.914613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 140/271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:58 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:59.139191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:59.139792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:59.147256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:59.147701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:59.148803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:59.149243 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:59.486164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:28:59.502272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-64cec908-5dc2-41aa-89eb-8225a6c7f271 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1504 microversion: 2.1 time: 0.368205 Jun 21 18:28:59.504312 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 132/272] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:59 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:28:59.933422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:28:59.934832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:28:59.941508 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:59.942380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:59.943257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:59.943751 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:00.205971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:00.215503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-241d033b-50cb-498f-bc17-bf4cd8be6c6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.286547 Jun 21 18:29:00.217172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 141/273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:28:59 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:00.406717 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-a46d6ed8-65b1-4fe0-b249-edbb99e91e2d req-cd668f9c-e6d7-4c39-997f-7f854180863c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe21569-881a-476d-93e9-0b8d0af9fc52", "name": "network-vif-deleted", "tag": "e6bb3e1a-a073-4e95-803b-19493bb8bdb9"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:00.415938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-a46d6ed8-65b1-4fe0-b249-edbb99e91e2d req-cd668f9c-e6d7-4c39-997f-7f854180863c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:00.416433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-a46d6ed8-65b1-4fe0-b249-edbb99e91e2d req-cd668f9c-e6d7-4c39-997f-7f854180863c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:00.430912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-a46d6ed8-65b1-4fe0-b249-edbb99e91e2d req-cd668f9c-e6d7-4c39-997f-7f854180863c service nova] Creating event network-vif-deleted:e6bb3e1a-a073-4e95-803b-19493bb8bdb9 for instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 on hv-cinder-83124 Jun 21 18:29:00.437595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-a46d6ed8-65b1-4fe0-b249-edbb99e91e2d req-cd668f9c-e6d7-4c39-997f-7f854180863c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Jun 21 18:29:00.438347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 133/274] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:00.520559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:00.521168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:00.527636 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:00.528082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:00.528910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:00.529345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:00.620098 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:00.633890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2a72751e-9ab1-40b9-a3eb-f28b8167e412 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1462 microversion: 2.1 time: 0.116858 Jun 21 18:29:00.636589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 142/275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:00 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:01.239091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:01.239091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:01.243010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:01.243499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:01.244307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:01.244944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:01.438335 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:01.461364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1e93341c-d39a-4fa7-beb3-92f020179a05 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.230338 Jun 21 18:29:01.464604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 134/276] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:01 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:01.667330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:01.669547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:01.681208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:01.683022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:01.685410 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:01.685959 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:01.750334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:01.752138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:01.753254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lazy-loading 'fault' on Instance uuid 7fe21569-881a-476d-93e9-0b8d0af9fc52 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:29:01.825113 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:01.835180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-19e691ca-7439-4b6d-98d6-e912efcdd298 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 200 len: 1304 microversion: 2.1 time: 0.175584 Jun 21 18:29:01.836514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 143/277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:01 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:02.491059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:02.492355 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:02.505379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:02.506668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:02.508106 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:02.509140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:02.814217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:02.836003 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8c4dbe65-6067-481a-8949-f949a9e5762a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.350946 Jun 21 18:29:02.866805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 135/278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:02 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:02.867663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:02.868450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 7fe21569-881a-476d-93e9-0b8d0af9fc52] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:02.877874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:02.878432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:02.879889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:02.882278 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:02.920812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] HTTP exception thrown: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Request method failure captured: Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 HTTP/1.1 Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg3Flczgk00G74yHoon2W5O1bFnnRXuyJqrDcEul0n2xSZl-l_esM6WSe6jj9qRvzq4mzfBl9Hr3EGNkXyrPNkJGQK36Z_B7Q6uSDqVw4HsKdt4Mo8dp32mNWsplRo6T2wD1graoKV6AVmPnZ7zI6upYwJ39UCZ9guEMRIPDIMGbAqA Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 444a0fac8c834c3cab5ba1df5a261aac Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesActionsTest-191413852 Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:29:02.930478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesActionsTest-191413852 Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 444a0fac8c834c3cab5ba1df5a261aac Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesActionsTest-191413852 Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesActionsTest-191413852-project Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: b6bbd45ee6964c4986f3c778ab8ad231 Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesActionsTest-191413852-project Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. Jun 21 18:29:02.932740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '7fe21569-881a-476d-93e9-0b8d0af9fc52'} Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:02.933536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. Jun 21 18:29:02.935122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:29:02.936478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Returning 404 to user: Instance 7fe21569-881a-476d-93e9-0b8d0af9fc52 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:02.937433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e20fbb6c-d415-4067-8c7a-eb3ac938d2f8 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52" status: 404 len: 111 microversion: 2.1 time: 0.075258 Jun 21 18:29:02.946324 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 144/279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:02 2022] GET /compute/v2.1/servers/7fe21569-881a-476d-93e9-0b8d0af9fc52 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:29:03.063385 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-950171888", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "networks": [{"uuid": "94d63e97-3d02-4417-a35f-f6916d4c6d76"}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:03.132756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] validate_networks() for [('94d63e97-3d02-4417-a35f-f6916d4c6d76', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:03.533397 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:03.534012 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:03.534313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:03.534726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:03.535139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:03.545756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:03.546243 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:03.547056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:03.547497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:03.554518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:03.565349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Getting quotas for project 444a0fac8c834c3cab5ba1df5a261aac. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:03.569631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Getting quotas for user b6bbd45ee6964c4986f3c778ab8ad231 and project 444a0fac8c834c3cab5ba1df5a261aac. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:03.584134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:03.586626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:03.798846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-97e851a3-37d9-42dd-b4b9-927e711afde0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729934 Jun 21 18:29:03.798846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 136/280] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:29:03.809619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-10f56dc9-7b07-43fa-9747-02ffc904a70f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:03.811628 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-10f56dc9-7b07-43fa-9747-02ffc904a70f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:03.891284 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:03.891902 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:03.910934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:03.911382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:03.914152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:03.914783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:03.939758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-10f56dc9-7b07-43fa-9747-02ffc904a70f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:03.958425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-10f56dc9-7b07-43fa-9747-02ffc904a70f tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1213 microversion: 2.1 time: 0.156696 Jun 21 18:29:03.958425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 145/281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:03 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:04.158559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:04.171953 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-26673648-03d3-40ae-b2e8-cc80650aa645 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.301850 Jun 21 18:29:04.173115 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 137/282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:03 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:04.988782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:04.989853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:05.000987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:05.001822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:05.003258 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:05.003996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:05.103038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:05.112411 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b01508d-849d-4d26-b8af-0cb2dede36e0 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1217 microversion: 2.1 time: 0.130706 Jun 21 18:29:05.113351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 146/283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:04 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:05.192615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:05.193484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:05.200770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:05.201307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:05.202225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:05.202842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:05.393024 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:05.404773 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a1572b0e-4884-4877-af1b-cbbd5e888aaa tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.216537 Jun 21 18:29:05.406413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 138/284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:05 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:06.133858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:06.134758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:06.171851 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:06.186647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:06.188217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:06.189016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:06.296232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:06.313531 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7b4e9ca6-c9df-48a4-86a8-9bd83b2019c4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1265 microversion: 2.1 time: 0.184195 Jun 21 18:29:06.313531 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 147/285] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:06 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:06.434676 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:06.437222 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:06.451657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:06.452937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:06.455706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:06.457077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:06.756165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:06.766216 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c2335450-0a65-4cf2-95bc-3313812a4bb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.344650 Jun 21 18:29:06.776026 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 139/286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:06 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:07.330937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:07.331929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:07.343247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:07.347998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:07.353105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:07.355210 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:07.451572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:07.458625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:07.467695 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-63d5466e-ebe2-45b9-9f60-d09daee2ab84 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1271 microversion: 2.1 time: 0.141868 Jun 21 18:29:07.468888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 148/287] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:07 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:07.798947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:07.804134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:07.833269 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:07.836146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:07.838431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:07.839232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:08.099662 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:08.118974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-646e7c47-cb8f-40c7-8a3e-e2f5a3a2aba3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.335292 Jun 21 18:29:08.122613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 140/288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:07 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:08.494964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:08.496309 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:08.498737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=62 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:08.504615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:08.505130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:08.505930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:08.506367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:08.665077 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:08.673875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1d070baa-1afd-49cc-b180-2b57ee05fdf4 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.183439 Jun 21 18:29:08.674466 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 149/289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:08 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:09.145374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:09.148262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:09.152274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:09.164601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:09.166881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:09.169878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:09.171810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:09.184011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fbdd0db5-9a77-462c-b3a8-cc019d56801e req-09a7f8dd-eb4e-404f-8318-c811e7ba4bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d67f01-c4b2-4a3d-af7a-e65f485b42d9", "tag": "421b0484-bbf0-4d6c-86e9-f19f4a6f0268"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:09.205744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbdd0db5-9a77-462c-b3a8-cc019d56801e req-09a7f8dd-eb4e-404f-8318-c811e7ba4bdb service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:09.206318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbdd0db5-9a77-462c-b3a8-cc019d56801e req-09a7f8dd-eb4e-404f-8318-c811e7ba4bdb service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:09.229569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fbdd0db5-9a77-462c-b3a8-cc019d56801e req-09a7f8dd-eb4e-404f-8318-c811e7ba4bdb service nova] Creating event network-changed:421b0484-bbf0-4d6c-86e9-f19f4a6f0268 for instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 on hv-cinder-83124 Jun 21 18:29:09.236672 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fbdd0db5-9a77-462c-b3a8-cc019d56801e req-09a7f8dd-eb4e-404f-8318-c811e7ba4bdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063594 Jun 21 18:29:09.238220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 150/290] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:09.502511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:09.514271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-29002023-b0c0-43fd-92e3-7ab8c94a017b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.375871 Jun 21 18:29:09.515007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:09 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:09.692919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:09.695422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:09.718594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:09.718594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:09.718594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:09.719760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:09.910235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:09.922405 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-adb3a899-1eb8-4a54-8b09-6cde88b7433c tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.234473 Jun 21 18:29:09.927168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 151/292] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:09 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:10.544973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:10.546332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:10.554134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:10.554586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:10.555414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:10.555870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:10.730852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:10.739838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1babb324-eb3b-43bc-9db8-560c14aa2a60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.199396 Jun 21 18:29:10.740628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 142/293] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:10 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:10.947301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:10.948026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:10.954590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:10.955047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:10.955832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:10.956271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:11.120506 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:11.129161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-538d6c87-4922-42d4-9800-8600f3344b30 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.185869 Jun 21 18:29:11.130171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 152/294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:10 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:11.762117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:11.763137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:11.771609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:11.772304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:11.773276 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:11.773847 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:11.946317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:11.955212 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ccde9b87-b923-4fe8-8316-ca1abba2f0d3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.198478 Jun 21 18:29:11.955799 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 143/295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:11 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:12.146795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:12.147678 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:12.154060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:12.154498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:12.155469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:12.157630 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:12.305479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:12.314385 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4d0e689e-4315-46f4-b6c3-25e3905c92c6 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.171401 Jun 21 18:29:12.315169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:12 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:12.986522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:12.987956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:13.001262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:13.002005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:13.003868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:13.004808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:13.259940 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:13.277742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8fee6a3d-47b7-4a95-a63d-27efb43cb7c0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.297394 Jun 21 18:29:13.278879 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 144/297] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:12 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:13.343990 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:13.345142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:13.358667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:13.358667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:13.358667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:13.362760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:13.581014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:13.593747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d1c24dbb-f425-4de5-932f-452d53e5e43e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.255229 Jun 21 18:29:13.594739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 154/298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:13 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:14.305027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:14.306788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:14.309791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:14.311075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=6 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:14.319314 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:14.320013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:14.321226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:14.321774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:14.614311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:14.615458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:14.619134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:14.630263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:14.631187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:14.636028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:14.637324 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:14.666398 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:14.681344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f2a25245-0027-4fd2-83b1-2aca45d95a9f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.381050 Jun 21 18:29:14.688630 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 145/299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:14 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:14.887426 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:14.902701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2782e7f1-0405-40f4-9c49-488a62ef0dfe tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.295458 Jun 21 18:29:14.925838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 155/300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:14 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:15.349319 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-c33fb8ad-adbd-421d-8339-a33577ad71cb req-af7183b6-eb60-4056-834e-82598017bbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d67f01-c4b2-4a3d-af7a-e65f485b42d9", "name": "network-vif-plugged", "status": "completed", "tag": "421b0484-bbf0-4d6c-86e9-f19f4a6f0268"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:15.366493 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-c33fb8ad-adbd-421d-8339-a33577ad71cb req-af7183b6-eb60-4056-834e-82598017bbe5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:15.367242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-c33fb8ad-adbd-421d-8339-a33577ad71cb req-af7183b6-eb60-4056-834e-82598017bbe5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:15.383591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-c33fb8ad-adbd-421d-8339-a33577ad71cb req-af7183b6-eb60-4056-834e-82598017bbe5 service nova] Creating event network-vif-plugged:421b0484-bbf0-4d6c-86e9-f19f4a6f0268 for instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 on hv-cinder-83124 Jun 21 18:29:15.390312 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-c33fb8ad-adbd-421d-8339-a33577ad71cb req-af7183b6-eb60-4056-834e-82598017bbe5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047632 Jun 21 18:29:15.391246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 146/301] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:15.703885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.704544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:15.712130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:15.712622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:15.713425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:15.713866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:15.887719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:15.898016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fc1f07ef-6e0d-46df-a645-0dddcc88775a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.198403 Jun 21 18:29:15.898627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 156/302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:15.929349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.930133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:15.937595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:15.938047 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:15.938893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:15.939382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:16.148672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:16.160794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3205e885-97b2-498b-ab59-0191cf46eacd tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.235772 Jun 21 18:29:16.161556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 147/303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:16.915703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:16.923663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:16.925798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:16.926258 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:16.927046 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:16.927476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:17.183513 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:17.184383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:17.195364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:17.196200 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:17.197969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:17.199752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:17.236552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:17.247316 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d0e0345e-647f-42e3-b170-8d3fb6ed1919 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.335731 Jun 21 18:29:17.247919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 157/304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:16 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:17.428861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:17.439112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-433b9746-99d1-4d39-b75d-e9f64ecf0268 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1313 microversion: 2.1 time: 0.259566 Jun 21 18:29:17.439981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 148/305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:17 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:18.269855 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:18.270938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:18.282661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.283463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.284914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.285719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.337136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:18.338054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:18.347631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.348490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.350022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.350819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.384825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2894c58e-ed0f-4b2b-98d5-3924f677a505 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/ips" status: 200 len: 153 microversion: 2.20 time: 0.052289 Jun 21 18:29:18.385657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 149/306] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jun 21 18:29:18 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/ips => generated 153 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:29:18.465625 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:18.465625 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:18.468995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.468995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.469570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:18.470011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:18.540237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:18.563053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f5c2953b-017e-4069-a12a-85f031034d6c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.300012 Jun 21 18:29:18.579399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 158/307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:18 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:18.704553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:18.713875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5b1ac110-29d5-420b-a62c-e34e59ff0583 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1497 microversion: 2.1 time: 0.258203 Jun 21 18:29:18.714465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 150/308] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:18 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:19.596655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:19.598059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:19.610783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:19.611550 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:19.612983 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:19.613759 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:19.824191 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:19.847529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d5b695dd-792b-48be-9e46-ba39a22db48b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.259399 Jun 21 18:29:19.848561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 159/309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:19 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:20.275130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:20.277577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:20.283365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:20.283821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:20.284663 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:20.285117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:20.315822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f5e84ee8-68f3-4d6f-8ca5-1cf0e8c01db8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/ips" status: 200 len: 150 microversion: 2.1 time: 0.044950 Jun 21 18:29:20.431774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 151/310] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:29:20 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:20.865823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:20.866767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:20.875544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:20.881996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:20.881996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:20.881996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:21.044041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:21.056865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-92c1f759-b58d-418d-acec-7106969a830b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.191503 Jun 21 18:29:21.056865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 160/311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:20 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:21.280834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:21.281427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:21.288650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:21.289106 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:21.290105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:21.290475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:21.321780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lazy-loading 'flavor' on Instance uuid 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:29:21.665409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:22.074253 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:22.075644 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:22.083625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:22.084660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:22.085957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:22.086732 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:22.086909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5d51aa7b-caef-476b-b946-e96e7a4a23b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/action" status: 202 len: 0 microversion: 2.20 time: 0.809799 Jun 21 18:29:22.088861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 152/312] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jun 21 18:29:21 2022] POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:29:22.107687 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:22.109300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:22.121196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:22.122044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:22.122985 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:22.123518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:22.285365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:22.303980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4df2ca3a-fb09-4fe4-96f7-124229eb7cae tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.235725 Jun 21 18:29:22.304960 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 161/313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:22 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:22.336486 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:22.343324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:22.344930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:22.346199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a4a8f15c-a922-4c1b-8bf2-db44b6932c83 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.250140 Jun 21 18:29:22.346776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 153/314] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:22 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:23.322504 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:23.323398 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:23.330085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:23.330540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:23.331328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:23.331770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:23.376479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:23.377356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:23.388823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:23.389584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:23.391131 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:23.391964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:23.557656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:23.567427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8fa31502-34d9-47e7-981d-1f583e5f61e8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.249157 Jun 21 18:29:23.568502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 162/315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:23 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:23.637317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:23.653885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:23.653885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:23.653885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-71086a9d-f140-47e5-ac38-f09dc43ed543 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.282923 Jun 21 18:29:23.654247 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 154/316] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:23 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:24.038601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.039754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:24.047887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.048488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.049377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.049810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.085069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:29:24.540484 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-45dac5df-41b8-40be-8376-fcc30e826f89 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 204 len: 0 microversion: 2.1 time: 0.500794 Jun 21 18:29:24.540484 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 163/317] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:29:24 2022] DELETE /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:29:24.549567 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.550519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:24.558760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.559664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.560533 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.561005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.597519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.598269 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:24.605497 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.606282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.610836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.610836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.659495 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:24.778625 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:24.794543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1047ed81-7e8a-4ede-b7e8-a236c35343af tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1503 microversion: 2.1 time: 0.251981 Jun 21 18:29:24.795998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 155/318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:24 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:24.828019 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.829077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:24.837846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.840038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.845146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.845760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.909915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:24.939406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5b89574c-2719-476c-96d8-f4b266286e1f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.345740 Jun 21 18:29:24.941429 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:24 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:24.950465 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a64a581-45da-4a09-8f26-faead79fd5f9"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:24.953025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:24.962169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.963560 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:24.964984 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:24.965575 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:25.101550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:25.114398 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:25.121149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:25.121149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-51591d2a-711f-41a1-9ea3-7ef7349d7a4d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.303098 Jun 21 18:29:25.121149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 156/320] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:24 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:25.838744 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.841202 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:25.853600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:25.854871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:25.856474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:25.857653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:26.387726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:26.398082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-07dd9fb2-ecf6-446e-9003-19a61a5c3643 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1503 microversion: 2.1 time: 0.572821 Jun 21 18:29:26.398947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 157/321] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:26.408997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:26.410142 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:26.419365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:26.419871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:26.420933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:26.421693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:26.630435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:26.645559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-77eb3b6d-2a33-44e5-922d-0e4b1768cdad tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1502 microversion: 2.1 time: 0.244949 Jun 21 18:29:26.646474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 158/322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:26 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:26.663399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:26.663399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:26.670791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:26.671935 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:26.673561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:26.674132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.006665 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:27.024606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:27.030125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:27.033193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3622ecf5-5040-467d-98ed-6da641977ca4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.383716 Jun 21 18:29:27.034878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 159/323] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:26 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:27.047343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9894bca2-b2a8-4565-83e6-8cbb77687604"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:27.050055 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:27.064566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.065271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.066657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.067573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.111328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] HTTP exception thrown: Cannot 'attach_volume' instance 7b830661-c720-48f3-95c1-803626d60a9d while it is in vm_state rescued Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Request method failure captured: Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/os-volume_attachments HTTP/1.1 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 74 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2HublXDJAIGwn0eNOGwP1YcsFgcFZEKXYyC2wd2NgCaRgL9K5yqzOiUDINHuJeDP_GebOwDuGO3yydvRBwCIsj9DyjTGZt6loXQhr_81XvbIJ34MHdvvPwEHXNLUzv1FrMZiBQc-5mPGxS_7wLGXXfVghHMVu2SFgtPiZve3-htV4 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:29:27.113520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 59f011e91b684e1288dad5f0ac733c0f Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {"volumeAttachment": {"volumeId": "9894bca2-b2a8-4565-83e6-8cbb77687604"}} Jun 21 18:29:27.116440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Cannot 'attach_volume' instance 7b830661-c720-48f3-95c1-803626d60a9d while it is in vm_state rescued Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'server_id': '7b830661-c720-48f3-95c1-803626d60a9d', 'body': {'volumeAttachment': {'volumeId': '9894bca2-b2a8-4565-83e6-8cbb77687604'}}} Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b830661-c720-48f3-95c1-803626d60a9d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:27.118001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7b830661-c720-48f3-95c1-803626d60a9d while it is in vm_state rescued Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:27.121219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7b830661-c720-48f3-95c1-803626d60a9d while it is in vm_state rescued Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Returning 409 to user: Cannot 'attach_volume' instance 7b830661-c720-48f3-95c1-803626d60a9d while it is in vm_state rescued {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0eb3b088-4b7a-438d-bbd5-80f4097a6305 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078410 Jun 21 18:29:27.124114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 160/324] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:29:27 2022] POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 18:29:27.128177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:27.128881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:27.137749 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.138272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.139122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.139558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.489409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ad9d7c82-df3a-4a08-b5ad-9fb16108ef76 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/action" status: 202 len: 0 microversion: 2.1 time: 0.365317 Jun 21 18:29:27.490390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 161/325] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:29:27 2022] POST /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:29:27.499328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:27.501034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:27.513407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.514013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.515116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.515638 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.596127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:27.607526 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-77520146-e36a-4727-a41e-35cd33ece117 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1461 microversion: 2.1 time: 0.115492 Jun 21 18:29:27.620878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 162/326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:27 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:27.620878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:27.620878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:27.663111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.664016 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.666706 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3382b2c7-12e4-4c09-9a5d-596fe1b11903 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.705788 Jun 21 18:29:27.667457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.677763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 165/327] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:29:24 2022] POST /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments => generated 194 bytes in 2728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:27.683698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:27.926969 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-cc49e112-b748-493f-aeeb-a8f9ad66abb7 req-702c0d29-dbd2-43fd-b593-34a483bded0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d67f01-c4b2-4a3d-af7a-e65f485b42d9", "name": "network-vif-deleted", "tag": "421b0484-bbf0-4d6c-86e9-f19f4a6f0268"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:27.949492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cc49e112-b748-493f-aeeb-a8f9ad66abb7 req-702c0d29-dbd2-43fd-b593-34a483bded0c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:27.952533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cc49e112-b748-493f-aeeb-a8f9ad66abb7 req-702c0d29-dbd2-43fd-b593-34a483bded0c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.011869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-cc49e112-b748-493f-aeeb-a8f9ad66abb7 req-702c0d29-dbd2-43fd-b593-34a483bded0c service nova] Creating event network-vif-deleted:421b0484-bbf0-4d6c-86e9-f19f4a6f0268 for instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 on hv-cinder-83124 Jun 21 18:29:28.036536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-cc49e112-b748-493f-aeeb-a8f9ad66abb7 req-702c0d29-dbd2-43fd-b593-34a483bded0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131990 Jun 21 18:29:28.040099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 166/328] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:28.087190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:28.089988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:28.109146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:28.110797 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.112842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:28.114552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.152969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:28.169998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bcdc94a7-c8b8-4b75-8520-b0a0825d9852 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1510 microversion: 2.1 time: 0.559459 Jun 21 18:29:28.171078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 163/329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:27 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:28.454407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:28.454407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:28.454798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:28.454798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-85a18127-feb1-4c49-98d7-4f3365052434 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.381068 Jun 21 18:29:28.454798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 167/330] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:28 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:28.644039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:28.646900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:28.658619 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:28.659416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.660897 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:28.661803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.711136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:28.711776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:28.712325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lazy-loading 'fault' on Instance uuid 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:29:28.779855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:28.797795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-451a2501-cb49-4480-95c7-0f0babaa08ba tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1303 microversion: 2.1 time: 0.163396 Jun 21 18:29:28.799868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 164/331] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:28 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:29.188782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:29.189620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:29.199659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.200506 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.202210 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.202798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.406901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:29.422552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-be4efe2c-652f-4f75-9a0e-bf373a3d0044 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1510 microversion: 2.1 time: 0.237395 Jun 21 18:29:29.433491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 168/332] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:29 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:29.491266 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:29.493130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:29.502325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.503063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.504158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.504875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.680782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:29.692243 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:29.694051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:29.695487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8fa008dc-8c36-481f-bfbd-b4167e4b792b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.209796 Jun 21 18:29:29.696208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 165/333] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:29 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:29.834331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:29.835083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:29.843746 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.844715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.845625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.846285 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.887992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:29.888451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:29.888930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lazy-loading 'fault' on Instance uuid 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:29:29.939968 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bbd45ee6964c4986f3c778ab8ad231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a0fac8c834c3cab5ba1df5a261aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:29.954097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dbe532a3-29f1-4d9a-aad6-f8b7df48231e tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 200 len: 1303 microversion: 2.1 time: 0.127555 Jun 21 18:29:29.955092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 169/334] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:29 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:30.442708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:30.443863 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:30.450964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.452145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:30.453096 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.453824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:30.671758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:30.682480 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2e1368b2-b65f-45c3-906d-73db6abfce47 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1510 microversion: 2.1 time: 0.243533 Jun 21 18:29:30.683199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 166/335] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:30 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:30.723158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:30.727073 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:30.734062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.734516 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:30.735389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.735829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:30.975759 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:30.977073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] [instance: 57d67f01-c4b2-4a3d-af7a-e65f485b42d9] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:30.987120 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.988222 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:30.989702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:30.990739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:31.011422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] HTTP exception thrown: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Request method failure captured: Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 HTTP/1.1 Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg3Flczgk00G74yHoon2W5O1bFnnRXuyJqrDcEul0n2xSZl-l_esM6WSe6jj9qRvzq4mzfBl9Hr3EGNkXyrPNkJGQK36Z_B7Q6uSDqVw4HsKdt4Mo8dp32mNWsplRo6T2wD1graoKV6AVmPnZ7zI6upYwJ39UCZ9guEMRIPDIMGbAqA Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 444a0fac8c834c3cab5ba1df5a261aac Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesActionsTest-191413852 Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:29:31.013872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/444a0fac8c834c3cab5ba1df5a261aac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesActionsTest-191413852 Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 444a0fac8c834c3cab5ba1df5a261aac Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesActionsTest-191413852 Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesActionsTest-191413852-project Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: b6bbd45ee6964c4986f3c778ab8ad231 Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesActionsTest-191413852-project Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. Jun 21 18:29:31.016447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '57d67f01-c4b2-4a3d-af7a-e65f485b42d9'} Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:31.017988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. Jun 21 18:29:31.021520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:29:31.028783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] Returning 404 to user: Instance 57d67f01-c4b2-4a3d-af7a-e65f485b42d9 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:31.028783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-41ef249e-b27d-4ce4-9e2d-2f79313d9460 tempest-VolumesActionsTest-191413852 tempest-VolumesActionsTest-191413852-project] 10.222.0.23 "GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9" status: 404 len: 111 microversion: 2.1 time: 0.049071 Jun 21 18:29:31.028783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 167/336] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:30 2022] GET /compute/v2.1/servers/57d67f01-c4b2-4a3d-af7a-e65f485b42d9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:29:31.308412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:31.320029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:31.321649 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:31.323498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e956b0cb-ee05-4669-84a6-1e83eca31a69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.604559 Jun 21 18:29:31.324054 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 170/337] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:30 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:31.726154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:31.728846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:31.746669 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:31.747864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:31.749881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:31.750925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:32.146328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:32.154934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b64231d1-dcf2-4612-988d-d03a8678460b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1516 microversion: 2.1 time: 0.442289 Jun 21 18:29:32.155522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 168/338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:31 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1516 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:32.346760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:32.347589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:32.358000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:32.358510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:32.359270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:32.359712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:32.725431 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:32.753171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:32.757413 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:32.765022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c5d219f2-ad37-42c1-bdf9-47805c0168c0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.421959 Jun 21 18:29:32.773539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 171/339] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:32 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:33.810189 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:33.812224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:33.823148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:33.823836 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:33.825216 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:33.825951 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:33.834829 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:34.059014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:34.070241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:34.073591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:34.075145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-079a5b66-13f1-4b89-88ed-af29cf89bd0d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.271819 Jun 21 18:29:34.075991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 169/340] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:33 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:35.102036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:35.103065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:35.112078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:35.112746 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:35.113666 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:35.114275 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:35.323974 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:35.334988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:35.338986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:35.340708 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3e382719-5edc-40cc-b8d1-e1984d0545e8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.243412 Jun 21 18:29:35.341372 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 172/341] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:35 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:36.369046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:36.369729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:36.378005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:36.378461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:36.379589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:36.380049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:36.537702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:36.546890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:36.548446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:36.549641 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2f1c7999-c1c0-4b83-9740-e1f18886daa2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.184920 Jun 21 18:29:36.550210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 170/342] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:36 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:37.528249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4f1c2f97-8f2e-4d3d-84e5-4b9280eba985 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: .version_select at 0x7fd39c210940>, body: {"keypair": {"name": "tempest-keypair-559631262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/6HbdRxuuSNc04pXTZI0qEjRWhjBfj5EpZwVaeM2S7D20Ci4glhaOaXcoP+soMR18EleIfsIY6089A9aZuVDok9qAeKAU+cbLTWaVzGdlxdaWbT1Z2yiSXVZyhMIiNyg=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:37.546220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4f1c2f97-8f2e-4d3d-84e5-4b9280eba985 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for project 10aedc59673c405096de01eaf61ecd6f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:37.550914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-4f1c2f97-8f2e-4d3d-84e5-4b9280eba985 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for user 59f011e91b684e1288dad5f0ac733c0f and project 10aedc59673c405096de01eaf61ecd6f. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:37.573591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:37.574435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:37.584587 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:37.585092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:37.585871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:37.586409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:37.705126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4f1c2f97-8f2e-4d3d-84e5-4b9280eba985 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181020 Jun 21 18:29:37.706434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 173/343] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:29:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:37.830093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:37.848644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:37.850827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:37.855726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c0df3f63-150d-482a-9919-339826ceec2c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.289341 Jun 21 18:29:37.859875 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 171/344] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:37 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:38.002740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-31128bf7-9c1a-4e84-ab56-37c7d9b419ea tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: .version_select at 0x7fd39c21dd30>, body: {"keypair": {"name": "tempest-keypair-275232042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ79SQoXkgK0Y18sk8HMYNCGkEHhNOaSfeqUXaKnqsHfcbL4xzE+5dX1rxqYU6Yrj/YSF0HbDFcB66Dz6KJmAeyCjsARsSnB97Wd+WePS1wUWngjRFjENEs4g2HzQT8wg=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:38.042872 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-31128bf7-9c1a-4e84-ab56-37c7d9b419ea tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:38.055434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-31128bf7-9c1a-4e84-ab56-37c7d9b419ea tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:38.195622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-31128bf7-9c1a-4e84-ab56-37c7d9b419ea tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196424 Jun 21 18:29:38.200820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 174/345] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:29:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:38.909511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:38.909511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:38.951797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:38.953167 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:38.957443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:38.958501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:39.324121 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:39.353326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:39.355821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:39.357318 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-99595a22-0cc3-4e77-b46a-5e491654ba66 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.468624 Jun 21 18:29:39.372440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 172/346] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:38 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:29:40.420880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:40.446858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:40.488958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:40.499144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.501774 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:40.506201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.507549 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:40.851445 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:40.883829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:40.889450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:40.892254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-79ca3714-7884-4528-90e4-b12a6b1b1013 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.479027 Jun 21 18:29:40.895310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 175/347] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:40 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:41.926474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:41.927538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:41.940234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=66 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:41.943830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:41.945113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:41.951315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:41.951315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:42.155186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:42.167673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:42.170734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:42.172242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f2a3a9d9-deab-4537-bcf9-48d7b3984a47 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.252552 Jun 21 18:29:42.174084 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 173/348] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:41 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:42.736412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1536013719", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c311bd00-da3b-4520-a15e-cdf04bcdf59d"}], "security_groups": [{"name": "tempest-securitygroup--876478003"}], "key_name": "tempest-keypair-559631262", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:43.087035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] validate_networks() for [('c311bd00-da3b-4520-a15e-cdf04bcdf59d', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:43.206553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:43.209067 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:43.230490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:43.231976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:43.233768 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:43.234842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:43.489725 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:43.506745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:43.510704 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:43.513503 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-09c69500-0ee2-473c-978e-08afa26fee8d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1746 microversion: 2.20 time: 0.316124 Jun 21 18:29:43.514843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 174/349] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:43 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1746 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:44.245037 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1718537051", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89bb927a-5407-4745-a764-78e1bdbbf5fe"}], "security_groups": [{"name": "tempest-securitygroup--250350947"}], "key_name": "tempest-keypair-275232042", "user_data": "}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:44.306215 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:44.308083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:44.309220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:44.310169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:44.311637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:44.330114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.331273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.333514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.334607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.391919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:44.402103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Getting quotas for user 59f011e91b684e1288dad5f0ac733c0f and project 10aedc59673c405096de01eaf61ecd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:44.431849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:44.439350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:44.530919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] validate_networks() for [('89bb927a-5407-4745-a764-78e1bdbbf5fe', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:44.627085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa7e1634-2d6d-456a-aa4d-57eadabb0cfb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.901587 Jun 21 18:29:44.629144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 176/350] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:29:44.653245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:44.654645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:44.671181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.672286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.674891 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.675901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:45.208015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:45.247558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:45.257028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:45.265626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a63db5ff-c6bb-4ec5-b22d-7e2e7b1bb47f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1746 microversion: 2.20 time: 0.629925 Jun 21 18:29:45.266962 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 177/351] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:44 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1746 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:45.291116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:45.291946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:45.292119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:45.292620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:45.293053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:45.300066 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-224166f8-f335-4170-aa45-1cc33395bdb5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:45.305359 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:45.305809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:45.307025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-224166f8-f335-4170-aa45-1cc33395bdb5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:45.308463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:45.309448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:45.343017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:45.356653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:45.384808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:45.387961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:45.502102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-224166f8-f335-4170-aa45-1cc33395bdb5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:45.534095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8e9f9048-1bfc-4135-a766-3bf16466b03f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.297656 Jun 21 18:29:45.534615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 175/352] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:29:45.554229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-224166f8-f335-4170-aa45-1cc33395bdb5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1245 microversion: 2.1 time: 0.277689 Jun 21 18:29:45.557721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 178/353] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:45 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1245 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:45.569845 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fbfa4b00-9229-4625-bafa-7be22016de93 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:45.573512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fbfa4b00-9229-4625-bafa-7be22016de93 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:45.706474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fbfa4b00-9229-4625-bafa-7be22016de93 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:45.720180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fbfa4b00-9229-4625-bafa-7be22016de93 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1241 microversion: 2.1 time: 0.166123 Jun 21 18:29:45.721647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 176/354] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:45 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:46.302547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:46.303581 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:46.318009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.319125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.319823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.320579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.496947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.507028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.508813 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.510153 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-46f6583d-4eb5-41d1-8945-de1a92a890ab tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1746 microversion: 2.20 time: 0.215579 Jun 21 18:29:46.510736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 179/355] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:46 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:29:46.589457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:46.590089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:46.597707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.600777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.600777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.600777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.687778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.696110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6a31793f-5e4b-423a-a3c3-c994220d3840 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1249 microversion: 2.1 time: 0.111947 Jun 21 18:29:46.696783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 177/356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:46 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:46.751431 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:46.752200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:46.760657 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.763613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.763613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:46.763613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:46.842070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.842197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b9622917-3e8c-461f-83b0-0fe2ae88ca2a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1245 microversion: 2.1 time: 0.095201 Jun 21 18:29:46.842750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 180/357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:46 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:47.532077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:47.532840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:47.543146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.544918 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.546649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.548274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.725950 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:47.727238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:47.743280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.747092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.748349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.751327 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.751893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.763495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.766043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.767241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-cd83c074-ac7b-46e3-8405-49c11b79f5ae tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1746 microversion: 2.20 time: 0.239669 Jun 21 18:29:47.767995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 178/358] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:47 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:29:47.827717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.842975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-47f8a5e5-23a6-4e58-9e93-968742d34257 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1249 microversion: 2.1 time: 0.122538 Jun 21 18:29:47.868869 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:47.870321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:47.871897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 181/359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:47 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1249 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:47.880487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.891449 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.891449 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.891449 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.983662 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.995973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b2f5e1ee-3d4e-4d20-99a5-26a29f41be0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1245 microversion: 2.1 time: 0.139494 Jun 21 18:29:47.997470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 179/360] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:47 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:48.802876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:48.805170 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:48.818316 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:48.819679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:48.822587 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:48.823964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:48.938841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:48.940516 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:49.021526 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.022105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.023076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.023602 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.146976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:49.169906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:49.185790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-891b1b42-6b8c-46f4-8e89-1b18bcc4e29b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1297 microversion: 2.1 time: 0.263406 Jun 21 18:29:49.186778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 180/361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:48 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1297 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:49.189499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:49.203622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:49.206220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9917cf82-a47f-455c-a5e5-ed6b531eca6e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.410612 Jun 21 18:29:49.211535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 182/362] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:48 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:49.258317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:49.261148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:49.286077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.286572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.292278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.293152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.543370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:49.588989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-2adbf2aa-fe35-4388-8f8b-6fda30b91591 req-6b28c19a-f62f-443d-ba08-9aea77496577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "name": "network-vif-plugged", "status": "completed", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:49.638898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3d270699-48d0-4900-9065-f3be5c9f4dfb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1293 microversion: 2.1 time: 0.450286 Jun 21 18:29:49.664950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 181/363] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:49 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:49.666405 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2adbf2aa-fe35-4388-8f8b-6fda30b91591 req-6b28c19a-f62f-443d-ba08-9aea77496577 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.669782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-2adbf2aa-fe35-4388-8f8b-6fda30b91591 req-6b28c19a-f62f-443d-ba08-9aea77496577 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.727063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-2adbf2aa-fe35-4388-8f8b-6fda30b91591 req-6b28c19a-f62f-443d-ba08-9aea77496577 service nova] Creating event network-vif-plugged:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:29:49.754469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-2adbf2aa-fe35-4388-8f8b-6fda30b91591 req-6b28c19a-f62f-443d-ba08-9aea77496577 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163570 Jun 21 18:29:49.754469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 183/364] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:50.209511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:50.220631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:50.239343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.246050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.247948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:50.253016 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.254664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.261380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:50.316031 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.326856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.338920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.341351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.470971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:50.517234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.547180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2b658acf-835a-460e-a641-80ae2ead4b0f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1315 microversion: 2.1 time: 0.345293 Jun 21 18:29:50.557079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 182/365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:50 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:50.684874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:50.685816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:50.721524 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.721990 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.722831 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:50.723369 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.763998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.774501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.777388 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.778919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c66963d8-2514-413d-850b-bcbbd458b385 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.539297 Jun 21 18:29:50.780145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 184/366] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:50 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:50.960710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.975944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-eeb5b3a3-2adb-4122-bb95-d821e4d23c9a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1299 microversion: 2.1 time: 0.296403 Jun 21 18:29:50.977232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 183/367] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:50 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:51.598180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:51.607548 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:51.629613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.636030 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.638212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.641522 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.831022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:51.833915 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:51.876068 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.876568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.878131 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.878590 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.894059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:51.917913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4f4014c2-b128-4df1-9e60-afdb4ed9d0b3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1303 microversion: 2.1 time: 0.327794 Jun 21 18:29:51.923741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 185/368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:51 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1303 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:52.034573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:52.036139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:52.055633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:52.078244 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:52.079898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:52.081557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:52.192923 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:52.210903 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:52.213399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:52.218772 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b12b122c-ae35-4880-b4b7-9becf2b394b7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.405400 Jun 21 18:29:52.225004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 184/369] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:51 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:52.341095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:52.349474 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bafbd57d-e276-47f8-8eb0-0c236bd7a402 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.338561 Jun 21 18:29:52.350328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 186/370] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:52 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:52.945404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:52.948271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:52.963678 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:52.964282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:52.965482 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:52.965928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:53.207860 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:53.221906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2a288e0e-8522-49d9-9e94-c65a06f1eb99 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1303 microversion: 2.1 time: 0.280054 Jun 21 18:29:53.222876 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 185/371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:52 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:53.253319 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:53.257203 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:53.281072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:53.281556 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:53.282510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:53.285241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:53.378331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:53.379322 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:53.393354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:53.393354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:53.404596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:53.405505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:53.854452 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:53.877042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:53.886519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:53.892919 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e5876a7a-84ee-4838-ac31-b3a28b9062b4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.648125 Jun 21 18:29:53.910904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 187/372] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:53 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:53.932991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:53.962086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8656eea9-bb2b-4697-8a9e-ac0542c3a4b2 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.588298 Jun 21 18:29:53.977406 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 186/373] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:53 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:54.256723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:54.267729 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:54.286176 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:54.286616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:54.288410 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:54.288954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:54.374727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:54.818715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:54.842878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ce9488e5-1dfa-48fe-8e81-a1bb6c96fbf2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1303 microversion: 2.1 time: 0.590250 Jun 21 18:29:54.845946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 188/374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:54 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1303 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:54.915860 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:54.916916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:54.928323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:54.931448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:54.935006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:54.935712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:54.975014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:54.995281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:54.995905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:55.018957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.024543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.024543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.024543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.319684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:55.422366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:55.439981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:55.440996 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:55.442247 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-33a693b9-6ac5-4899-a2c8-82c097bebb91 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.531066 Jun 21 18:29:55.442812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 187/375] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:54 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:55.515671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=16 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:55.867328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:55.868089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:55.889864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=8 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:55.897345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.901494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.905237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.905742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:56.063979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:56.122805 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-45c4e604-14da-486c-acc0-54d46c7d9c94 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 1.122275 Jun 21 18:29:56.122805 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 189/376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:54 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:56.235346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-80aa0a48-4574-48c0-a831-4453a05ac6a7 req-3d9d7602-ca9d-4325-8de4-43ebbe9a6a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ef497d-b88f-46b1-a17e-badb7fb350f4", "tag": "b5169c45-8070-472a-aa80-3079a90bb1e6"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:56.326026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-80aa0a48-4574-48c0-a831-4453a05ac6a7 req-3d9d7602-ca9d-4325-8de4-43ebbe9a6a7c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:56.333722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-80aa0a48-4574-48c0-a831-4453a05ac6a7 req-3d9d7602-ca9d-4325-8de4-43ebbe9a6a7c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:56.379522 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-80aa0a48-4574-48c0-a831-4453a05ac6a7 req-3d9d7602-ca9d-4325-8de4-43ebbe9a6a7c service nova] Creating event network-changed:b5169c45-8070-472a-aa80-3079a90bb1e6 for instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 on hv-cinder-83124 Jun 21 18:29:56.396758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-80aa0a48-4574-48c0-a831-4453a05ac6a7 req-3d9d7602-ca9d-4325-8de4-43ebbe9a6a7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169214 Jun 21 18:29:56.397748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 190/377] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:56.477820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:56.478710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:56.498524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:56.498872 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:56.502725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:56.503199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:56.681924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:56.696293 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6f144ae9-2963-4fa7-ba01-8e722fc35a9a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.838183 Jun 21 18:29:56.703378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 188/378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:55 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:57.006120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.017763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.039273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.039273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9bc3fb56-5ea6-44f0-a673-d99b2d99a95d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.563055 Jun 21 18:29:57.044364 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 191/379] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:56 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:29:57.138139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:57.138809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:57.162603 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:57.163066 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.167388 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:57.167846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.723658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:57.724703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:57.741428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:57.744294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.745557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:57.748470 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.867626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.899489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-587ac0e8-c798-4803-9041-4da5b923199c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.766015 Jun 21 18:29:57.927104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 189/380] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:57 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:58.060508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:58.061604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:58.089097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.090024 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:58.100715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.102665 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:58.391615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:58.404641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2809f0f8-ec70-4332-bac5-10694c961102 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.685011 Jun 21 18:29:58.405739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 192/381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:57 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:58.936179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:58.937070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:58.971972 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.979559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:58.992047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.992678 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:59.138423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:59.168002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:59.173164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:59.177250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a00132e1-7487-42d0-9b44-87a15d2954ff tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 1.124504 Jun 21 18:29:59.184313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 190/382] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:29:58 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:29:59.432508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:59.433314 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:59.445932 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:59.446907 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:59.459129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:59.461775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.169282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:00.184443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-07d2855a-2c91-4dfb-95e2-073e8e8137e9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.755753 Jun 21 18:30:00.189660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 191/383] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:59 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:00.215880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-74f5c08b-b542-4633-ad70-ae012f4d974e req-d856d759-6dc5-4736-a9cd-7ca1c00c8767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:00.245215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-74f5c08b-b542-4633-ad70-ae012f4d974e req-d856d759-6dc5-4736-a9cd-7ca1c00c8767 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.257183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-74f5c08b-b542-4633-ad70-ae012f4d974e req-d856d759-6dc5-4736-a9cd-7ca1c00c8767 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.310060 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-74f5c08b-b542-4633-ad70-ae012f4d974e req-d856d759-6dc5-4736-a9cd-7ca1c00c8767 service nova] Creating event network-changed:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:30:00.313686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-74f5c08b-b542-4633-ad70-ae012f4d974e req-d856d759-6dc5-4736-a9cd-7ca1c00c8767 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121163 Jun 21 18:30:00.325381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 192/384] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:00.344841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:00.345962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:00.363069 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.373502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.375528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.375528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.498221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:00.522837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7e94043-7f96-4f4a-a99c-711e1d75b6e4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 1.590506 Jun 21 18:30:00.523619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 193/385] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:58 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:01.208802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:01.210565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:01.227746 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.229082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.234297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.235955 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.331853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:01.360372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:01.371909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:01.373181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-134046b8-aca7-4029-b300-234bd0c91b45 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 1.046236 Jun 21 18:30:01.375366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 193/386] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:00 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:01.571969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:01.574367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:01.653043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.654580 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.683767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.686088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.755226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:01.755226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-74205cf5-d114-4abd-a179-2904df55c31f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.542755 Jun 21 18:30:01.755226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 194/387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:01 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:02.392669 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:02.393323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:02.411373 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:02.412911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:02.414843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:02.417104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:02.630998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:02.658704 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-856dfe2a-72fb-44d9-aed4-f18eb6d5ef74 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 1.106262 Jun 21 18:30:02.659747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 194/388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:01 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:02.788753 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:02.792078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:02.827808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:02.828352 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:02.829741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:02.841129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:02.929890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:02.942042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:02.944066 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:02.945567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e9596e13-f87a-45c1-9ab1-c1386898e52e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.557088 Jun 21 18:30:02.950065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 195/389] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:02 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:03.354912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:03.372431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-862690e2-2ee8-44cc-a49b-7b0f3e1ae98d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.591777 Jun 21 18:30:03.373723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 195/390] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:02 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:03.687804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:03.687804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:03.705858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.706333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.707987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.707987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.965696 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:03.967124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:03.980285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.987198 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.988368 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.989030 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.161800 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.173144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-15377154-5451-4880-bced-fa4f34f8c155 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.492380 Jun 21 18:30:04.174271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 196/391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:03 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:04.404965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:04.406036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:04.422122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.422862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.423900 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.426769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.526372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.550265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.556636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.558896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-339fcff7-8b07-4931-bd45-cd7bd5c6e2e6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.597633 Jun 21 18:30:04.566543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 196/392] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:03 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:04.877881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.963395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-31fc330e-4239-4d48-a2d1-2a84180c90d7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.562155 Jun 21 18:30:04.965973 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 197/393] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:04 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:05.202589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.203975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:05.215795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.216596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.219006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.220205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.509381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:05.597705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.598668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:05.599250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8d20726e-9f6a-438f-bb5e-976ca75fe5bc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.395938 Jun 21 18:30:05.613910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.614798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.616013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.616724 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.627278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 197/394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:05.994128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.995051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:06.012882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.013741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.015132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.015994 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.267547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.289047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.294333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.295916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2781454d-7bb2-4fc5-bc69-060797b31148 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.702623 Jun 21 18:30:06.304806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 198/395] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:06.380712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.399111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-16ee31ab-caa0-4e96-93a9-c154c467a5d8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.409780 Jun 21 18:30:06.409968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 198/396] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:06.637976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:06.638901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:06.650011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.650612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.654921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.655611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.992267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.002202 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-90a7676c-aa88-442d-9ba6-09f578c67ab8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.368373 Jun 21 18:30:07.007959 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 199/397] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:06 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:07.327327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:07.329768 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:07.378936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.382623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.386423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.393620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.432091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:07.432908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:07.447777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.448836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.450317 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.453202 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.832718 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.846563 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.853148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.857170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-edf2a4a3-aaf6-4072-9dd1-996c7f58a419 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.541641 Jun 21 18:30:07.859552 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 199/398] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:07 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:07.871424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.899189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-88434b03-55e1-4053-9de6-e7c7a7c5c02c tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.467779 Jun 21 18:30:07.908758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 200/399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:07 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:08.028087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.028935 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.052014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.052501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.053328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.059673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.698034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:08.719259 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5381570d-d68e-43aa-a83d-dba1afa49ae7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.697294 Jun 21 18:30:08.728194 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:08.879810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.881614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.917169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.918922 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.920331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.922629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.928721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.931056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.948178 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.948988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.950638 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.968125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.218967 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.233168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e4a69c77-039f-493b-9b52-6f7853584cf8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.308382 Jun 21 18:30:09.243818 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 201/401] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:09.277952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.288110 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:09.294920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.298013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.299656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0c2485c0-4688-410b-89e6-635739d2b2bb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.426187 Jun 21 18:30:09.301003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 201/402] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:09.766560 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:09.767263 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:09.774440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.774959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.775919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.776377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.956700 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.971221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8bbff889-5546-4e0a-bfd9-cd5781c09467 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.208706 Jun 21 18:30:09.971959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 202/403] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:09 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:10.253732 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:10.255040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:10.265153 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.265546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.266743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.267282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.319634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:10.320593 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:10.329221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.334074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.347029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.348033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.620880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.647987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.652221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-de76efc1-1fb4-4665-9e91-dbcb4f84482a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.404203 Jun 21 18:30:10.653362 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 202/404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:10 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:10.661020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.678971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.678971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-74310591-5fe4-455c-a02e-2b6a6936656e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.349087 Jun 21 18:30:10.678971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 203/405] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:10 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:10.990367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:10.991473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.001222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.011889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.021187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.021187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.339565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.348757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ee0039a1-53c9-4699-ad54-8dc038249e8b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.362837 Jun 21 18:30:11.349806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 203/406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:10 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:11.675163 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:11.678996 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.689750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:11.690650 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.693050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.693519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.694473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.694979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.697658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.698102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.698880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.699311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.860281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.876155 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.877607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.881029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d71da5bb-6dbe-4dd7-b26e-39f3b859870c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.197403 Jun 21 18:30:11.884596 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 204/407] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:11 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:11.888523 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.897185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:11.908044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-95c0410d-9c66-45eb-9963-9d923688ca60 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.240270 Jun 21 18:30:11.909629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 204/408] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:11 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:12.376324 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:12.377022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:12.391334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.391791 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.396796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.397536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.662419 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:12.676844 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d1705ecd-a7c2-49f7-ba86-655b8deba2b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.305490 Jun 21 18:30:12.678305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 205/409] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:12 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:12.907872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:12.909992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:12.913655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:12.922185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.922913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.924221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.924933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.928743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:12.930135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:12.932760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:12.941895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.943664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.945301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.946632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.198730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.220469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fc8e0460-33f7-4dae-b12c-f4109283adb2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.296963 Jun 21 18:30:13.222234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 206/410] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:12 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:13.297018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.313734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.316736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.318911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b4d5014d-509d-4194-80d5-7802fe1c0924 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.417845 Jun 21 18:30:13.319778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 205/411] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:12 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:13.697228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:13.698141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:13.707720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.708311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.709340 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.710095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.969937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.982662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-94058b00-05a8-4adf-8617-d595d0fc908b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.290641 Jun 21 18:30:13.984307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 207/412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:13 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:14.246965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:14.247885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:14.256113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.256113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.256812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.257484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.367925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:14.373117 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:14.405725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.406734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.406943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.410187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.527098 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:14.552703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-aca96686-1e4d-4f03-ae96-d62e63dfefb0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.308463 Jun 21 18:30:14.557332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 206/413] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:14 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:14.642241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:14.656965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:14.658765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:14.660034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-06f8ccf1-1cd1-4caa-9809-95b34f574b26 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.312321 Jun 21 18:30:14.661138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 208/414] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:14 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:15.005627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:15.006629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:15.016094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.017058 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.018474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.019085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.248872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.268085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6fb22f02-3e6d-42ee-9c1e-96617f31a7e0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.268471 Jun 21 18:30:15.269291 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 207/415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:14 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:15.585330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:15.586911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:15.598890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.599697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.601197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.602004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.687049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:15.688122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:15.702535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.703386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.704489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.705402 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.925059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.938580 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.938898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.938898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.940485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4029c287-f78f-42fe-8222-ba34d6657d59 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1741 microversion: 2.20 time: 0.261121 Jun 21 18:30:15.954705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 208/416] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:15 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:15.980777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-edb22c40-7366-4f5c-b88d-2e8cead15284 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.402325 Jun 21 18:30:15.981866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 209/417] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:15 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:16.295327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.296180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.309329 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.309802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.310705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.311217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.566880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:16.573968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-97b33e14-74a4-4612-a551-ab1053583a4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.281475 Jun 21 18:30:16.574413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 209/418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:16.967754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.969376 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.980001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.980494 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.981519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.981958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.004769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:17.010563 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:17.022228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.025554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.026568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.027231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.239608 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.276560 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c85b13ba-d4c7-4abd-9325-82716741b7c9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.280052 Jun 21 18:30:17.277561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 210/419] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:17.403149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.416624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.418684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.419928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f1b07b03-f4a1-46e5-bdd9-075462b6b391 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1723 microversion: 2.20 time: 0.460845 Jun 21 18:30:17.423859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 210/420] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:17.597159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:17.598681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:17.611405 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.612216 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.620083 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.620083 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.814859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.826416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-66185718-9985-44fa-b66d-2bd7de91b9f4 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.236588 Jun 21 18:30:17.827459 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 211/421] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:17 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:18.302539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:18.303721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:18.321194 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.322167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.323988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.324769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.441379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:18.442026 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:18.454673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.455395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.456550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.460494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.564803 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.574036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-07b16dd4-f33a-430d-a3a5-bd4df804098a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.281803 Jun 21 18:30:18.574689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 211/422] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:18.810721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.825536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.827474 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.828736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3c441063-24b1-4ac5-ab3b-0da17b6522c3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1723 microversion: 2.20 time: 0.391574 Jun 21 18:30:18.829307 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 212/423] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:18.849971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:18.851571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:18.863867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.864735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.866168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.866959 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.099543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:19.107526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d5905f54-4be6-4274-a626-01c93d89fd29 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.266233 Jun 21 18:30:19.108483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 212/424] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:19.625672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.628572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.659008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.660203 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.666143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.672363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.704512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fbf8d147-07fe-411e-81fc-31467bb22a23 req-6a4b8a1e-1d1d-4f8e-9d8a-26825889f15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "name": "network-vif-unplugged", "status": "completed", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:19.759669 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbf8d147-07fe-411e-81fc-31467bb22a23 req-6a4b8a1e-1d1d-4f8e-9d8a-26825889f15d service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.765956 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbf8d147-07fe-411e-81fc-31467bb22a23 req-6a4b8a1e-1d1d-4f8e-9d8a-26825889f15d service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.835541 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fbf8d147-07fe-411e-81fc-31467bb22a23 req-6a4b8a1e-1d1d-4f8e-9d8a-26825889f15d service nova] Creating event network-vif-unplugged:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:30:19.880316 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fbf8d147-07fe-411e-81fc-31467bb22a23 req-6a4b8a1e-1d1d-4f8e-9d8a-26825889f15d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161341 Jun 21 18:30:19.885712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 213/425] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:19.898937 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.901579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.927614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.929954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.935800 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.936815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.203814 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:20.222236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7b22c811-81aa-4d59-8b82-1ac1a4866ad3 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.632263 Jun 21 18:30:20.245737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 213/426] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:19 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:20.260762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:20.260762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:20.278370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.279895 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.283260 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.284550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.419282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:20.429530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:20.436146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:20.437853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5a0b059d-16ba-48d6-8413-9b034f3b9604 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1723 microversion: 2.20 time: 0.549798 Jun 21 18:30:20.440856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 214/427] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:19 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:21.127544 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.145694 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c3e25d92-ef61-4c47-b6d2-583cb105e7fe tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.896434 Jun 21 18:30:21.148262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 214/428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:20 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:21.260234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:21.263873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:21.290894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.297186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.297186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.297186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.475297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:21.477642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:21.491817 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.495331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.498104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.500725 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.603259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.623460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a99a3551-8d4a-4004-8e80-2011583d6fcf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.371244 Jun 21 18:30:21.651661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 215/429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:21 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:21.901236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.911611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.913214 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.915180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-003b670f-b047-4a3c-b421-ea313cd9f0db tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1666 microversion: 2.20 time: 0.444921 Jun 21 18:30:21.916301 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 215/430] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:21 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:21.948767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2fb590b-49ab-4e8a-8e27-39b78b7f89ec"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:21.950719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:21.959169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.960615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.965726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.967809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.173789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:22.173789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:22.181288 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.181924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.182959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.183729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.398600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.417408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9b1fe01a-5261-41ca-93b1-2d3e8fe7a1c5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.248571 Jun 21 18:30:22.422975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 216/431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:22 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:22.663231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:22.666026 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:22.684936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.689171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.690302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.694176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.946947 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.956739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-cdeadb93-8e46-4fd3-9969-30e66cffa01f tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.300883 Jun 21 18:30:22.973897 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 217/432] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:22 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:23.172306 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:23.263231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a2159c90-f367-452d-88e0-cf3b24df4882 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.320760 Jun 21 18:30:23.264336 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 216/433] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jun 21 18:30:21 2022] POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 188 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:30:23.439980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.440579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.448538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.452718 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.452718 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.452718 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.453875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:23.454223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.473475 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.481269 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.482744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.483220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.723548 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:23.732181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2cf55565-c9b2-4fe9-97af-e714f6bf512a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.296726 Jun 21 18:30:23.732717 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 218/434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:23.801074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-02dd71d4-2dac-40a8-ba84-cc946233ccbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/action" status: 202 len: 0 microversion: 2.20 time: 0.357385 Jun 21 18:30:23.815587 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 217/435] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jun 21 18:30:23 2022] POST /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:30:23.825214 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.825919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.833466 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.837497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.838497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.842220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.975136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.977444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.988484 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.990141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.995195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.995195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.048623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.069566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.092653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.092653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e4f13f8f-06d5-4bcf-bd0e-24d51d7dd4ba tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1752 microversion: 2.20 time: 0.253217 Jun 21 18:30:24.092653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 219/436] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:24.093384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-3b47a80a-61cc-4a0e-ab41-09ae0ee95e0f req-bfaaacfd-68ba-41d0-bb6d-d9e6d32854c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ef497d-b88f-46b1-a17e-badb7fb350f4", "name": "network-vif-plugged", "status": "completed", "tag": "b5169c45-8070-472a-aa80-3079a90bb1e6"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:24.093384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-3b47a80a-61cc-4a0e-ab41-09ae0ee95e0f req-bfaaacfd-68ba-41d0-bb6d-d9e6d32854c9 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.093384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-3b47a80a-61cc-4a0e-ab41-09ae0ee95e0f req-bfaaacfd-68ba-41d0-bb6d-d9e6d32854c9 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.108280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-3b47a80a-61cc-4a0e-ab41-09ae0ee95e0f req-bfaaacfd-68ba-41d0-bb6d-d9e6d32854c9 service nova] Creating event network-vif-plugged:b5169c45-8070-472a-aa80-3079a90bb1e6 for instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 on hv-cinder-83124 Jun 21 18:30:24.114342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-3b47a80a-61cc-4a0e-ab41-09ae0ee95e0f req-bfaaacfd-68ba-41d0-bb6d-d9e6d32854c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038332 Jun 21 18:30:24.114962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 220/437] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:24.256280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.266290 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-58bf081a-e9cc-47d2-be82-22d7e7500061 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.294778 Jun 21 18:30:24.266880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 218/438] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:24.754710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:24.756164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:24.786555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.786555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.786555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.786555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.092824 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:25.093758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:25.101634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.108892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.111066 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.114031 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.115981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.128033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e6b8c4f9-82b8-4eb8-a309-6657f4626abb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.380112 Jun 21 18:30:25.141226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 221/439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:24 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:25.298371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:25.299502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:25.316873 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.330782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.330782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.330782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.349018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:25.381139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.399440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.407168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.409210 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c5cd89df-6d7e-434b-b9d0-72c01163c04e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1752 microversion: 2.20 time: 0.320839 Jun 21 18:30:25.411810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 219/440] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:25 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1752 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:25.779302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.793664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d95c61ab-c788-4a95-89d8-8d4924ed0cbc tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.509756 Jun 21 18:30:25.808577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 222/441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:25 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:26.137165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b6cd2411-5637-4a11-b94e-095911d181bc req-d5811b1c-f5ac-4d18-b4f3-fb4e22231af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "name": "network-vif-plugged", "status": "completed", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:26.149455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b6cd2411-5637-4a11-b94e-095911d181bc req-d5811b1c-f5ac-4d18-b4f3-fb4e22231af5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.150023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:26.150395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b6cd2411-5637-4a11-b94e-095911d181bc req-d5811b1c-f5ac-4d18-b4f3-fb4e22231af5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.150660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:26.161827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.162898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.163868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.167513 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b6cd2411-5637-4a11-b94e-095911d181bc req-d5811b1c-f5ac-4d18-b4f3-fb4e22231af5 service nova] Creating event network-vif-plugged:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:30:26.168492 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.173663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b6cd2411-5637-4a11-b94e-095911d181bc req-d5811b1c-f5ac-4d18-b4f3-fb4e22231af5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044271 Jun 21 18:30:26.176460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 220/442] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:26.450942 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:26.451851 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:26.471090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.471416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.472165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.481223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.715411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:26.725364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9e02c762-bf9f-40d7-b02f-8e69017b0780 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1366 microversion: 2.1 time: 0.580979 Jun 21 18:30:26.725722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 223/443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:26 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:26.815637 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:26.816806 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:26.829956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.835762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.839933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.843354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.283074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.294097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.295946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.298030 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-da1efb2c-fd1f-4391-9aaf-d6afbc229aaa tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1752 microversion: 2.20 time: 0.864564 Jun 21 18:30:27.299375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 221/444] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:26 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1752 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:27.332698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.351034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4bc4137c-3657-4f08-8eee-e3b1da965be6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.539539 Jun 21 18:30:27.361775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 224/445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:26 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:27.743060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:27.748173 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:27.755181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.755730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.756705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.757136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.079838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:28.095310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-764a4667-405e-43e3-a8e6-6c053b9a08dc tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1555 microversion: 2.1 time: 0.356753 Jun 21 18:30:28.096236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 222/446] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:27 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:28.123776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:28.128297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:28.146904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.147353 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.150691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.151290 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.292905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9b2159f3-6094-4f14-815d-7e06d0bc3612 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178633 Jun 21 18:30:28.293991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 225/447] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:30:28 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:28.319591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:28.320757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:28.330725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.331323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.332174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.332673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.369952 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:28.370626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:28.393950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.396283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.400729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.401498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.748171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:28.759825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-30e4a86b-d323-47c1-a1cb-1865476bf1a1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1370 microversion: 2.1 time: 0.393578 Jun 21 18:30:28.764137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 226/448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:28 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1370 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:29.455101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:29.485133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:29.491847 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:29.497112 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6a634fe4-23f8-4fd9-907f-f1d38ca916a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1752 microversion: 2.20 time: 1.181849 Jun 21 18:30:29.499156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 223/449] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:28 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1752 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:29.792226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:29.792902 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:29.826278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.834747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:29.835899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.837170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.163358 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:30.179177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-30fa4390-0c80-4654-b5be-656bbe500385 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1565 microversion: 2.1 time: 0.398758 Jun 21 18:30:30.181139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 227/450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:29 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1565 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:30.198492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:30.198987 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:30.218303 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.219004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.220135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.220783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.523228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-64125297-009e-49a4-b5af-e2af1e555a56 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.329825 Jun 21 18:30:30.530260 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 224/451] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:30:30 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:30.536512 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:30.537751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:30.548297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.549049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.550878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.551584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:31.768539 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:31.808803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:31.820815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:31.822893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6c8c4641-d77f-488b-9dfd-0c1013331718 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1754 microversion: 2.20 time: 1.301404 Jun 21 18:30:31.823664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 228/452] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:30 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1754 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:32.845125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:32.846018 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:32.866268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.866733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:32.867626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.868079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.227365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-e0205ff1-9932-4c1a-bbc8-8d2c33539bc2 req-d242a948-3a1a-4c31-bec2-fe4e64b7a35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ef497d-b88f-46b1-a17e-badb7fb350f4", "tag": "b5169c45-8070-472a-aa80-3079a90bb1e6"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:33.253253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-e0205ff1-9932-4c1a-bbc8-8d2c33539bc2 req-d242a948-3a1a-4c31-bec2-fe4e64b7a35f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:33.253836 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-e0205ff1-9932-4c1a-bbc8-8d2c33539bc2 req-d242a948-3a1a-4c31-bec2-fe4e64b7a35f service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.281645 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-e0205ff1-9932-4c1a-bbc8-8d2c33539bc2 req-d242a948-3a1a-4c31-bec2-fe4e64b7a35f service nova] Creating event network-changed:b5169c45-8070-472a-aa80-3079a90bb1e6 for instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 on hv-cinder-83124 Jun 21 18:30:33.296752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-e0205ff1-9932-4c1a-bbc8-8d2c33539bc2 req-d242a948-3a1a-4c31-bec2-fe4e64b7a35f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070978 Jun 21 18:30:33.297700 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 229/453] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:34.383184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:34.453079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:34.472754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:34.480470 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-eea0c32e-ca9c-4961-ae78-08fe957a89d0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.635669 Jun 21 18:30:34.482417 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 225/454] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:32 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:35.511960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:35.521448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:35.543942 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.544514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:35.547717 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.548305 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.329634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-0d63dacf-9c24-4acc-b433-302324b230bb req-554a760c-ef2d-4ba9-b209-ae769a24e9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:36.377676 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0d63dacf-9c24-4acc-b433-302324b230bb req-554a760c-ef2d-4ba9-b209-ae769a24e9ef service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:36.378342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0d63dacf-9c24-4acc-b433-302324b230bb req-554a760c-ef2d-4ba9-b209-ae769a24e9ef service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.427038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-0d63dacf-9c24-4acc-b433-302324b230bb req-554a760c-ef2d-4ba9-b209-ae769a24e9ef service nova] Creating event network-changed:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:30:36.461798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-0d63dacf-9c24-4acc-b433-302324b230bb req-554a760c-ef2d-4ba9-b209-ae769a24e9ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141984 Jun 21 18:30:36.467664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 226/455] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:36.518323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.547944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.560051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.563905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-948be67f-a5e1-47fb-ace7-f1741a91d9f2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.065773 Jun 21 18:30:36.577538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 230/456] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:35 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:37.591911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:37.592721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:37.639065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.640062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.646041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.655095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.387753 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:39.407133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:39.426135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:39.426135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dae8c9d2-1b95-4eb9-ac3e-949bfd0c60e2 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.836108 Jun 21 18:30:39.427574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 227/457] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:37 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:40.506493 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:40.525734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:40.574282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:40.575264 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:40.576503 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:40.577118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:41.609546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:41.679042 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:41.688755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:41.705652 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-beb7ecbe-97c3-43ea-bfaf-19797a687602 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.259540 Jun 21 18:30:41.733971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 231/458] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:40 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:42.746415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:42.748417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:42.763759 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.764448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.765433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.766382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:43.137078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ec333f45-ccac-4ef5-85bd-571ab21d6688 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Action: 'create', calling method: .version_select at 0x7fd39c1d54c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1496082875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEMF7YdRKI4S3OQLcdwvO6RLbJxisJ2yaV7kFVxA1k4gu30vom/LmaP+6tGpewxDc4Xm1q/yjgA3ukOnTsFGFFze/EQV3SLlTbAIMtyYRBLCzu13GgAmCk1AIniRs5bXA=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:43.137078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=46 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:43.138953 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:43.139154 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-ec333f45-ccac-4ef5-85bd-571ab21d6688 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Getting quotas for project 65efebfec3f0401190b3116e52d634e8. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:30:43.144379 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-ec333f45-ccac-4ef5-85bd-571ab21d6688 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Getting quotas for user 113b17a680c640f19b0f402f371c6cbb and project 65efebfec3f0401190b3116e52d634e8. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:30:43.149649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:43.167236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:43.172271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0e16d324-8074-4262-81ca-86c96385d856 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.433025 Jun 21 18:30:43.178249 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 232/459] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:42 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:43.596074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ec333f45-ccac-4ef5-85bd-571ab21d6688 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.029238 Jun 21 18:30:43.604554 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 228/460] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:30:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:44.205973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:44.208172 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:44.231952 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=56 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:44.239003 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:44.240054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:44.251581 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:44.252475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:44.731436 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:44.748111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:44.751973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:44.754349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2ad67987-128c-4b8b-95b0-f9ada205b8c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.555182 Jun 21 18:30:44.774862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 233/461] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:44 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:45.779129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:45.784906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:45.811978 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:45.814106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:45.821842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:45.823676 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:46.921760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:46.940789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:46.940789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:46.958916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9c513434-ca2b-458a-a021-c3313fa367f4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.168392 Jun 21 18:30:46.973924 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 229/462] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:45 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:47.995229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:47.995229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:48.026726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.028351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:48.037436 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.045111 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:48.495040 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:48.528525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:48.531993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:48.539821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9207b842-74cf-431a-8095-987c6986ec5d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.559234 Jun 21 18:30:48.549027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 234/463] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:47 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:49.604584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:49.616764 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:49.660271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:49.665490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:49.668425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:49.675113 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.605479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:50.621549 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:50.623224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:50.626252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7798e65f-bb5f-4a82-9529-a07c947d6145 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 1.044853 Jun 21 18:30:50.640761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 230/464] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:49 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:51.656003 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:51.656697 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:51.666860 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:51.668723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:51.669846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:51.670710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:52.084466 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:52.119943 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:52.127544 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:52.141566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7a74350f-0255-4be0-a5e3-4bc1b64d3213 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.489133 Jun 21 18:30:52.142767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 235/465] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:51 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:53.168701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:53.169358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:53.177151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:53.185574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:53.190826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:53.199824 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:53.202301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:53.937842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:53.946468 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:53.963179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:53.965962 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:53.967258 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ce2be415-87c1-4c72-9200-ee545fbad962 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.807551 Jun 21 18:30:53.967828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 231/466] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:53 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:54.986984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:54.987922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:54.995028 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:54.995799 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:54.996656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:54.997127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:55.284603 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:55.299270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:55.301916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:55.303448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b2f1460c-9c7b-47ff-b126-e95cffe5a66d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.320957 Jun 21 18:30:55.304190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 236/467] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:54 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:56.336552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:56.343007 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:56.353049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:56.353864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:56.355457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:56.355904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:56.585109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:56.609975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:56.609975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:56.609975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a537f6bd-dd85-43cf-982d-fbde1a9fce08 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.278063 Jun 21 18:30:56.610390 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 232/468] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:56 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:30:57.629185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:57.631101 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:57.643993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:57.644767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:57.646155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:57.646868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:57.672545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=83 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:58.035644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.051134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.052883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.054104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9730a61a-ef8f-405f-92d4-2007384f73c1 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.432234 Jun 21 18:30:58.055590 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 237/469] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:57 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:30:59.085940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:59.086946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:59.102074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.102646 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.103533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.108852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.354247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:59.364137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:59.365790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:59.367305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62a0d7dd-3deb-4f15-8396-adb6bb84bc53 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.285491 Jun 21 18:30:59.376234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 233/470] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:30:59 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:00.387573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:00.388230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:00.401086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.401846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.412380 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.412380 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.668987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:00.684586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:00.686670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:00.688603 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9b105dea-aac7-4d8b-a437-6661f6c0b014 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.305220 Jun 21 18:31:00.689868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 238/471] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:00 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:01.714349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:01.715761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:01.745763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.746789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:01.751327 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.755895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.288703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:02.307784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:02.311517 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:02.314679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c4f6e8c1-9234-4a28-ad25-53d90259a45c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.608325 Jun 21 18:31:02.332852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 234/472] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:01 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:03.345825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:03.347937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:03.356783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:03.358092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:03.359198 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:03.359843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:03.626890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:03.648736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:03.650654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:03.654109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c60228b9-935a-49ea-9a92-1e1c7d737a7b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.314250 Jun 21 18:31:03.660637 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 239/473] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:03 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:04.675535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:04.676450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:04.694276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.695776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.698437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.699130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.974045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:05.004479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:05.015051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:05.016536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-abe46b36-1cbc-444c-97b4-de8a6d040283 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.344893 Jun 21 18:31:05.018124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 235/474] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:04 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:05.172457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-adb05938-f32a-4514-acb3-f6ca2b23a7c7 req-7988b80f-e5b3-4e6d-82ba-1316daa690af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "name": "network-vif-plugged", "status": "completed", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:05.190109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-adb05938-f32a-4514-acb3-f6ca2b23a7c7 req-7988b80f-e5b3-4e6d-82ba-1316daa690af service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:05.191217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-adb05938-f32a-4514-acb3-f6ca2b23a7c7 req-7988b80f-e5b3-4e6d-82ba-1316daa690af service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:05.208945 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-adb05938-f32a-4514-acb3-f6ca2b23a7c7 req-7988b80f-e5b3-4e6d-82ba-1316daa690af service nova] Creating event network-vif-plugged:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:31:05.216228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-adb05938-f32a-4514-acb3-f6ca2b23a7c7 req-7988b80f-e5b3-4e6d-82ba-1316daa690af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056347 Jun 21 18:31:05.217530 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 240/475] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:06.049151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:06.050414 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:06.060061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:06.060862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:06.061915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:06.062352 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:06.252973 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:06.271675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:06.274532 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:06.275831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-21b0bac7-3a28-4316-b1e8-5ab3e33585f5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.231985 Jun 21 18:31:06.276765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 236/476] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:06 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:07.295733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:07.296603 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:07.303949 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:07.305189 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:07.306044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:07.306540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:07.481036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:07.490607 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:07.492893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:07.494085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b6ccb620-3ce0-4d1c-9668-6dd3ec113b8c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.203254 Jun 21 18:31:07.494655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 241/477] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:07 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:08.520787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:08.522129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:08.529137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:08.529892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:08.531012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:08.531630 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:08.749091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:08.760420 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:08.767843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:08.769839 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3a77d392-d158-468e-b382-426df5bc91be tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.253776 Jun 21 18:31:08.770902 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 237/478] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:08 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:09.795102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:09.796246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:09.807763 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:09.808681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:09.809529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:09.810146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:10.056592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:10.071068 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:10.073631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:10.075483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ac9c539e-bd48-4e7e-992a-05a017d9333e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.288418 Jun 21 18:31:10.076192 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 242/479] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:09 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:11.097796 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:11.099028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:11.110897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:11.112602 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:11.116402 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:11.116402 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:11.123530 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1915984116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1496082875", "security_groups": [{"name": "tempest-secgroup-smoke-1313890542"}], "networks": [{"uuid": "0208de17-96a8-42fc-926e-5be131a32858"}], "block_device_mapping_v2": [{"uuid": "ff0fef65-f90d-40ef-a866-ef046ffbd3e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:11.262679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] validate_networks() for [('0208de17-96a8-42fc-926e-5be131a32858', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:31:11.314766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:11.328284 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:11.330014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:11.331288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2578d189-7c1f-48c6-be7c-9b75552f297f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1810 microversion: 2.20 time: 0.240127 Jun 21 18:31:11.332145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 238/480] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:11 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:11.802675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:31:11.803496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:31:11.804861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:31:11.805256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:31:11.805853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:31:11.817186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:11.817540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:11.818368 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:11.818807 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:11.839477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Getting quotas for project 65efebfec3f0401190b3116e52d634e8. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:11.843999 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Getting quotas for user 113b17a680c640f19b0f402f371c6cbb and project 65efebfec3f0401190b3116e52d634e8. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:11.908925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:31:11.911277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff0fef65-f90d-40ef-a866-ef046ffbd3e6',volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:31:12.351477 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:12.352570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:12.358897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.359351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.360133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.360618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.430349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3adb1be8-ddf3-4b24-b153-c5a2856fb47d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.309837 Jun 21 18:31:12.436900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 243/481] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:31:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:31:12.441205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b09de8c4-fc2a-4116-a142-61ff4c707c89 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'create', calling method: .version_select at 0x7fd39c1e7dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-346600082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3KPI21aSfuOuGTPPaW+Z5RrwjSzNKBESNi43Vt555uxPx1DzgabKxj5yAWyTLEGgA/QLKcxXX27y66rF0jXelyqoJ8BWu+5l4RPDA7+WaGTmvSGIA2m3CeBZ25zPVXgA=="}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:12.486073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-b09de8c4-fc2a-4116-a142-61ff4c707c89 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Getting quotas for project 1a1786032e9449728e36f679515ced6d. Resources: {'key_pairs'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:12.496361 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-b09de8c4-fc2a-4116-a142-61ff4c707c89 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Getting quotas for user 0e634ab2f0944e24a087a10e36451f08 and project 1a1786032e9449728e36f679515ced6d. Resources: {'key_pairs'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:12.564052 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.574138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.576885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.577059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6f9064f8-050c-476c-a327-59149418750f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1797 microversion: 2.20 time: 0.230173 Jun 21 18:31:12.577627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 239/482] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:12 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1797 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:12.583134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a3186188-b6ab-4231-9c5c-0593049fb99b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:12.583976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a3186188-b6ab-4231-9c5c-0593049fb99b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:12.654130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a3186188-b6ab-4231-9c5c-0593049fb99b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.661249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a3186188-b6ab-4231-9c5c-0593049fb99b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1089 microversion: 2.1 time: 0.082380 Jun 21 18:31:12.661833 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 240/483] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:12 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1089 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:12.669617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b09de8c4-fc2a-4116-a142-61ff4c707c89 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.235888 Jun 21 18:31:12.670355 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 244/484] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:31:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:12.794672 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-76235912", "imageRef": "2bf24bc7-359e-4c0f-a60a-5744319450a7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-346600082", "networks": [{"uuid": "dd1da177-b83e-4950-8537-566f8e977cd0"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:12.871915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] validate_networks() for [('dd1da177-b83e-4950-8537-566f8e977cd0', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:31:13.379721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:31:13.380313 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:31:13.381061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:31:13.381607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:31:13.382033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:31:13.391780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.392230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:13.393080 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.393538 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:13.411846 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Getting quotas for project 1a1786032e9449728e36f679515ced6d. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:13.417229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Getting quotas for user 0e634ab2f0944e24a087a10e36451f08 and project 1a1786032e9449728e36f679515ced6d. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:13.429251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:31:13.431598 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2bf24bc7-359e-4c0f-a60a-5744319450a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:31:13.647657 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a3e30b6d-cd99-4d34-8fb0-8a60b12fdeed tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860885 Jun 21 18:31:13.648840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 241/485] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:31:13.659196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4752971f-ef56-4041-9896-013f0d4d5fea tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:13.659917 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4752971f-ef56-4041-9896-013f0d4d5fea tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:13.686823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-911e1e62-4f55-4cb7-a65c-6d828f1c7780 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:13.686823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-911e1e62-4f55-4cb7-a65c-6d828f1c7780 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:13.738355 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4752971f-ef56-4041-9896-013f0d4d5fea tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:13.746609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4752971f-ef56-4041-9896-013f0d4d5fea tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1256 microversion: 2.1 time: 0.091775 Jun 21 18:31:13.756973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 245/486] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:13 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1256 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:13.770466 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-911e1e62-4f55-4cb7-a65c-6d828f1c7780 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:13.784441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-911e1e62-4f55-4cb7-a65c-6d828f1c7780 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1089 microversion: 2.1 time: 0.109051 Jun 21 18:31:13.785345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 242/487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:13 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1089 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:14.768228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-45e22429-57e3-4853-b3ff-a9009bf1d1f5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:14.768819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-45e22429-57e3-4853-b3ff-a9009bf1d1f5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:14.771320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:14.807292 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:14.808198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:14.815286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:14.815733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:14.816602 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:14.817038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:14.827317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-45e22429-57e3-4853-b3ff-a9009bf1d1f5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:14.835667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-45e22429-57e3-4853-b3ff-a9009bf1d1f5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1256 microversion: 2.1 time: 0.071422 Jun 21 18:31:14.836651 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 246/488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:14 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1256 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:14.907165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:14.922992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e238dadc-c75d-4af2-ab4c-8e2082c76ec2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1187 microversion: 2.1 time: 0.120422 Jun 21 18:31:14.924099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 243/489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:14 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:15.853265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:15.854550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:15.866251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.873720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.873720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.873720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.941353 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:15.942204 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:15.945409 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:15.950766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.951345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.952229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.952813 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.967905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:15.975685 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-923bc6d1-ae2a-4de7-9032-cb4ebab45be9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1308 microversion: 2.1 time: 0.127164 Jun 21 18:31:15.976889 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 247/490] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:15 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:16.021534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:16.030279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b1d59b1a-f6ab-4743-a2e3-fa711b12c772 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1205 microversion: 2.1 time: 0.092747 Jun 21 18:31:16.030858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 244/491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:15 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:16.288363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:16.289052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:16.296468 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.297430 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.298335 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.298852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.328711 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-569411bb-ca53-4c88-8fae-939f0770e088 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/ips" status: 200 len: 148 microversion: 2.1 time: 0.044569 Jun 21 18:31:16.332674 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 248/492] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:31:16 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:16.343288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a64a581-45da-4a09-8f26-faead79fd5f9"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:16.345423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:16.357305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.357927 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.362250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.362250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.476728 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: POST /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/os-volume_attachments HTTP/1.1 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 74 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:31:16.479996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {"volumeAttachment": {"volumeId": "1a64a581-45da-4a09-8f26-faead79fd5f9"}} Jun 21 18:31:16.483151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'server_id': '92ef497d-b88f-46b1-a17e-badb7fb350f4', 'body': {'volumeAttachment': {'volumeId': '1a64a581-45da-4a09-8f26-faead79fd5f9'}}} Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:16.485059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:16.487566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 400 to user: Invalid volume: volume 1a64a581-45da-4a09-8f26-faead79fd5f9 is already attached to instances: db6b7d00-7d63-4188-a97f-783156275509 {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:16.490261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c94b4d90-d5f3-4ae6-8544-60c00ad2edce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146348 Jun 21 18:31:16.503497 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 245/493] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:31:16 2022] POST /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4/os-volume_attachments => generated 174 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:31:16.513498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:16.513498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:16.524471 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.525532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.527133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:16.528017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.598363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:31:17.003746 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:17.004617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.016838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.016838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.017763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.018281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.139301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:17.149331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dfb9f03c-84fb-4437-b9c2-76fda0ff93ba tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1326 microversion: 2.1 time: 0.150044 Jun 21 18:31:17.161159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 246/494] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:16 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1326 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:17.179245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:17.181360 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.186183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-df56603a-c5ed-4fbe-a805-633ff1662506 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 204 len: 0 microversion: 2.1 time: 0.675855 Jun 21 18:31:17.189060 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 249/495] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:31:16 2022] DELETE /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:31:17.191903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.192678 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.193903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.194679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.203129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:17.203901 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.238408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.239555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.242928 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.243730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.475353 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:17.483747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1ef44856-68f2-446c-89e0-d8af2e5eced7 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1273 microversion: 2.1 time: 0.320744 Jun 21 18:31:17.484663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 247/496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:17 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:17.540259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a40ba7a-b8e4-429e-81af-1b5a8332d8f7"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:17.541368 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.559743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.560592 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.562583 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.563408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.658766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:17.673872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-45a43b2a-7260-4a6f-8f86-588b094f4fe6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1679 microversion: 2.1 time: 0.480808 Jun 21 18:31:17.674939 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 250/497] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:17 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1679 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:17.684914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b77ce42c-4156-450a-9d24-e63341e9f8c2 req-9522fc0c-98be-4163-9463-beecd9828a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:17.701592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b77ce42c-4156-450a-9d24-e63341e9f8c2 req-9522fc0c-98be-4163-9463-beecd9828a63 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.704593 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b77ce42c-4156-450a-9d24-e63341e9f8c2 req-9522fc0c-98be-4163-9463-beecd9828a63 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.714592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b77ce42c-4156-450a-9d24-e63341e9f8c2 req-9522fc0c-98be-4163-9463-beecd9828a63 service nova] Creating event network-changed:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:31:17.722779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b77ce42c-4156-450a-9d24-e63341e9f8c2 req-9522fc0c-98be-4163-9463-beecd9828a63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045658 Jun 21 18:31:17.723567 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 251/498] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:18.169329 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:18.170027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:18.176717 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.177169 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.177948 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.178403 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.334775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:18.342610 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-50f151ea-0dd1-4f38-96d0-daf44d32b62e tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.178973 Jun 21 18:31:18.343184 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 252/499] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:18 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:18.502909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:18.504234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:18.511736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.512193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.513047 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.513724 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.794916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:18.806282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b0385097-606a-4e1a-bd59-4795243eea75 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.307935 Jun 21 18:31:18.817784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 253/500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:18 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:18.825995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:18.826797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:18.837222 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.838606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.839491 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.839934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.081177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:19.106246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6c140090-63bf-47e1-9545-a4036b3ae5bf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1679 microversion: 2.1 time: 0.295755 Jun 21 18:31:19.108218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 254/501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:18 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1679 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:19.360839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:19.369447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:19.385359 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.386251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.387347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.388222 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.510267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b94a153a-885d-4ba3-accc-b03cafbadd96 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.974880 Jun 21 18:31:19.511443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 248/502] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:31:17 2022] POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments => generated 194 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:19.769975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:19.782337 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7fd7958c-8733-4bd0-bfdf-df8d0365f716 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.425314 Jun 21 18:31:19.798707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 255/503] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:19 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:19.840993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:19.842853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:19.861145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.861693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.862669 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.863961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.140182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:20.141096 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:20.150270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.150883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.151870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.152543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.683428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:20.697982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b3ac14f7-46ea-4dfb-a554-ebc6e5d68e96 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1679 microversion: 2.1 time: 0.576265 Jun 21 18:31:20.699278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 256/504] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:20 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1679 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:20.705293 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-f32199dd-286c-450c-a135-a5dfc38766af req-1841ebe6-ea4f-4744-a711-c0aab5b655d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:20.724970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f32199dd-286c-450c-a135-a5dfc38766af req-1841ebe6-ea4f-4744-a711-c0aab5b655d0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.725780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f32199dd-286c-450c-a135-a5dfc38766af req-1841ebe6-ea4f-4744-a711-c0aab5b655d0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.783305 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-f32199dd-286c-450c-a135-a5dfc38766af req-1841ebe6-ea4f-4744-a711-c0aab5b655d0 service nova] Creating event network-changed:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:31:20.794949 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-f32199dd-286c-450c-a135-a5dfc38766af req-1841ebe6-ea4f-4744-a711-c0aab5b655d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093339 Jun 21 18:31:20.796519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 257/505] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:20.816957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:20.818051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:20.819251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:20.825748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:20.831741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.832498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.833472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.834097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.849662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b6db1272-0197-44b4-87d7-c3decc6cd4c1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 1.021782 Jun 21 18:31:20.851600 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 249/506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:19 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:20.867792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:21.087838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:21.107852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-95642a02-af33-44ac-997f-3ae8998a8a91 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.298443 Jun 21 18:31:21.109766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 258/507] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:20 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:21.731156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:21.731816 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:21.741991 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.742457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:21.743353 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.743818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:21.869925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:21.871243 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:21.874023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:21.891670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.892484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:21.894225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.894856 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.098060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.108298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bc647eb6-a06c-4918-aa8e-06abb64780ef tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.382343 Jun 21 18:31:22.128354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 250/508] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:21 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:22.129738 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:22.130644 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:22.135247 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.139425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.141090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.142394 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.143215 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.144677 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bae894a1-b93a-49d7-a1ee-f407ee290947 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.279936 Jun 21 18:31:22.145750 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 259/509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:21 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:22.164893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-92b4b43b-fc14-4ac7-a7b4-291d90a42308 req-0d886e82-aac8-4a62-8ec2-9e6efc4e0bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ef497d-b88f-46b1-a17e-badb7fb350f4", "name": "network-vif-deleted", "tag": "b5169c45-8070-472a-aa80-3079a90bb1e6"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:22.179784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-92b4b43b-fc14-4ac7-a7b4-291d90a42308 req-0d886e82-aac8-4a62-8ec2-9e6efc4e0bb3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.181306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-92b4b43b-fc14-4ac7-a7b4-291d90a42308 req-0d886e82-aac8-4a62-8ec2-9e6efc4e0bb3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.197420 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-92b4b43b-fc14-4ac7-a7b4-291d90a42308 req-0d886e82-aac8-4a62-8ec2-9e6efc4e0bb3 service nova] Creating event network-vif-deleted:b5169c45-8070-472a-aa80-3079a90bb1e6 for instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 on hv-cinder-83124 Jun 21 18:31:22.203315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-92b4b43b-fc14-4ac7-a7b4-291d90a42308 req-0d886e82-aac8-4a62-8ec2-9e6efc4e0bb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044945 Jun 21 18:31:22.204240 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 260/510] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:22.378662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.389779 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b695145-e62f-4731-a250-dcca8a6fd1d4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.265077 Jun 21 18:31:22.401552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 251/511] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:22 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:23.128618 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:23.129642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:23.142372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.142729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.148197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.149943 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.163028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:23.164733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:23.182491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.185031 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.186003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.190798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.317207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:23.342822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8d955808-d748-45e6-b40b-61340b17b495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.215703 Jun 21 18:31:23.346232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 261/512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:23 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:23.408854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:23.409762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:23.418463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.419121 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.420197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.422472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.423904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:23.611017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:23.632829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5523106b-8e90-4375-b4d7-d09356181f6e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.473199 Jun 21 18:31:23.641626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 252/513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:23 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:23.705822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:23.718487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-684982c6-4dcf-4d1a-81db-dcfeeb36a741 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.314351 Jun 21 18:31:23.728595 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 262/514] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:23 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:24.373323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:24.374151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:24.376583 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:24.395509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.395985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.396864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.397282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.527534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:24.536442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7b2750e-a052-432f-9ff2-06c6cab3175c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.167524 Jun 21 18:31:24.537372 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 253/515] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:24 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:24.651917 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:24.653821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:24.662865 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.663736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.664771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.665390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.744780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:24.748016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:24.787820 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.789344 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.791088 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.792249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.832031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=14 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:24.971989 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:24.991430 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4a3763a9-99ef-4575-8260-c6c2115b5997 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.343765 Jun 21 18:31:24.992992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 263/516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:24 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:25.068096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:25.082151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7cdafaf-a08b-40ee-b1a7-c31219b8c752 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.346773 Jun 21 18:31:25.098875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 254/517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:24 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:25.556334 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:25.557094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:25.568572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:25.569113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:25.570795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:25.571319 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:25.662518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:25.672401 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fa927529-ed57-4691-af3b-0804940378ff tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.121312 Jun 21 18:31:25.673359 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 264/518] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:25 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:26.023967 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:26.024660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:26.042877 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.043685 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.044757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.045406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.110225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:26.111126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:26.119365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.120132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.121050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.121549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.273993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:26.292806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-00a1f6c7-d764-43c8-8a4c-aabb538a4479 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.274592 Jun 21 18:31:26.305377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 255/519] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:26 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:26.418073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:26.427022 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7001a01c-f071-4424-8e8a-7229b7abfbb5 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.320611 Jun 21 18:31:26.427883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 265/520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:26 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:26.703103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:26.703715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:26.710612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.711092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.711878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.712322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.792484 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:26.801524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b63e9bb0-dc02-43a5-a1c6-fa895150f73a tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.102290 Jun 21 18:31:26.802223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 256/521] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:26 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:27.329613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:27.330302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:27.338042 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.338499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.339285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.339803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.445078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:27.445910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:27.454292 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.454292 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.455537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.455743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.499931 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:27.514545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-71126a85-97f5-45f3-b678-badef7c40e10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.188869 Jun 21 18:31:27.515747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 266/522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:27 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:27.686809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:27.696073 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-90061291-8208-4180-ba75-05216ad2d08a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.255899 Jun 21 18:31:27.696699 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 257/523] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:27 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:27.821886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:27.822533 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:27.839432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.839960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.840834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.841190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.919082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:27.927617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d154d5f9-9a2a-4ef9-a9a5-9d4de4b2c40b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.111847 Jun 21 18:31:27.928218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 267/524] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:27 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:28.541274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.547297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.549399 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.549933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.550753 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.551224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.715039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.716885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.731034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.731034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.731034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.731034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.779706 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:28.797907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bf99ed4c-3da7-4e3a-9ace-88c61d8f4382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.260890 Jun 21 18:31:28.799349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 258/525] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:28 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:28.935324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:28.944034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c01ad081-8771-4fb2-8fe2-2c098f5df977 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.233262 Jun 21 18:31:28.945611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 268/526] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:28 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:28.952168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.953455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.966999 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.968109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.969757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.970590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.092523 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:29.102710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-38ec6a83-9aa5-468c-a723-f6aebaf6213e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.158499 Jun 21 18:31:29.103478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 259/527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:28 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:29.832103 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:29.833030 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:29.842035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.842629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.843492 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.843939 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.969099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:29.969712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:29.977358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.977804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.978589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.979046 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.010513 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:30.019429 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-235fdd33-bde5-41eb-a0f5-492aa19a1c9f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.191454 Jun 21 18:31:30.025536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 269/528] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:29 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:30.124166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:30.124965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:30.133729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.134340 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.135278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.135900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.197223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:30.211443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-58cff25c-b805-460f-8715-412c6ec28f8a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.245286 Jun 21 18:31:30.212753 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 260/529] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:29 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:30.236466 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:30.244538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dc62ca45-8811-4270-be73-c3e47c39d396 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1612 microversion: 2.1 time: 0.126089 Jun 21 18:31:30.245288 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 270/530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:30 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1612 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:31.036585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:31.037288 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:31.045467 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.046114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.046981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.047461 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.201343 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.209897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9789d17c-94ac-4662-8f95-46f2c26fe0d1 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.177597 Jun 21 18:31:31.211403 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 261/531] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:31 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:31.234117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:31.235035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:31.243742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.244425 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.245411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.246067 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.270737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:31.271908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:31.281560 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.282546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.283654 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.284418 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.324565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.325430 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.325989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'fault' on Instance uuid 92ef497d-b88f-46b1-a17e-badb7fb350f4 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:31.401271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.409997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1592bd14-608d-4430-8f32-7f4c2e4e6191 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1331 microversion: 2.1 time: 0.147467 Jun 21 18:31:31.410612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 262/532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:31 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:31.430789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.440863 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-51a21ffb-6ff9-4457-99f7-acea59467187 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.212003 Jun 21 18:31:31.441469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 271/533] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:31 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:32.236979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.237903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.246996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.247485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.251529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.251529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.418697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.427092 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d2ed9ca8-5415-4367-af87-e22bbe0e1468 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.194350 Jun 21 18:31:32.427685 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 263/534] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:32.433071 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.434159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.446390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.447131 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.448058 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.448600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.459787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.461194 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.468721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.469396 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.470297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.470826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.496247 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.497072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.497812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'fault' on Instance uuid 92ef497d-b88f-46b1-a17e-badb7fb350f4 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:32.576791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.597661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ab2bc705-8919-4409-9298-7b3f01eefeb7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 200 len: 1331 microversion: 2.1 time: 0.168284 Jun 21 18:31:32.597661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 272/535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:32.685772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.700640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c89cdf40-ae78-4119-a450-fbabf9e53bca tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.245708 Jun 21 18:31:32.701691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 264/536] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:33.445510 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.446130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:33.453326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.453780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.454583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.455031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.614620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.617163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:33.627351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.629015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.630016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.630768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.653887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 HTTP/1.1 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:31:33.656192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:31:33.658859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '92ef497d-b88f-46b1-a17e-badb7fb350f4'} Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:33.662004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:31:33.667356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:33.671172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:33.671172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9911b2fd-cb7b-4f3f-ad09-5ce0383178f5 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 404 len: 111 microversion: 2.1 time: 0.049991 Jun 21 18:31:33.671172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 265/537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:33 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:31:33.674570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c924251b-0277-4d64-8426-c2f879692bc6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '.version_select at 0x7fd39c1f0430>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.688684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:33.702576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dfddd4c2-b7b7-48a3-ab32-2f1380d96a5a tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.261325 Jun 21 18:31:33.703577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 273/538] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:33 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:33.720771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.722187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:33.732091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.733279 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.733808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.734357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.766837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c924251b-0277-4d64-8426-c2f879692bc6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275232042" status: 202 len: 0 microversion: 2.1 time: 0.098408 Jun 21 18:31:33.776584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 266/539] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275232042 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:31:33.987509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:33.998832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7aa8945e-9f7e-4756-bd86-6c2e8188d1c9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.283416 Jun 21 18:31:33.999883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 274/540] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:33 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:34.035021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:34.036912 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:34.050583 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.051385 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.052831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.054199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.104577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'flavor' on Instance uuid 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:34.112634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:34.545461 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d0b10881-1a68-42a5-b2e8-3a889d81ac62 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/action" status: 200 len: 32 microversion: 2.1 time: 0.517488 Jun 21 18:31:34.547130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 267/541] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:31:34 2022] POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:31:34.570773 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:34.574617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:34.590656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.593783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.597187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.598292 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.612675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:34.731943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:34.733655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:34.745036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.745767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.746910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.747519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.913685 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:34.926643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-31b9747a-84e7-403c-af42-e4ccd328bbdf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.371108 Jun 21 18:31:34.927539 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 275/542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:34 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:35.017171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.017835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.040730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.042048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.047055 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.048045 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.190440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:35.199626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2f47f047-dcb5-476f-8209-f21a28db7f9b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.475251 Jun 21 18:31:35.204889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 268/543] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:34 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:35.269916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:35.278684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-240013cd-cdae-4e6a-872d-437768578c71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.265555 Jun 21 18:31:35.279371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 276/544] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:35 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:35.946139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.946976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.955071 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.955591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.956651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.957141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.974193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.975177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.986859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.987642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.989122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.989971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.150806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:36.168179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cf510906-4a1d-4366-8f41-f4092b5bd595 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.226947 Jun 21 18:31:36.169298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 269/545] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:35 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:36.171116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'services' on Instance uuid db6b7d00-7d63-4188-a97f-783156275509 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:36.228640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:36.229726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:36.241237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.241834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.243780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.244557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.428192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:36.438481 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1fdd1ff2-ce11-4ff4-ab7c-b492e1c9bc1d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.217675 Jun 21 18:31:36.439332 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 270/546] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:36 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:36.450178 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:36.451947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:36.462200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.462778 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.463711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.464239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.594125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-59b63f34-1449-4599-b172-d8f06b4d7537 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments/1a64a581-45da-4a09-8f26-faead79fd5f9" status: 202 len: 0 microversion: 2.1 time: 0.627328 Jun 21 18:31:36.599983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 277/547] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:31:35 2022] DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments/1a64a581-45da-4a09-8f26-faead79fd5f9 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:31:36.600438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-a8a05e83-d5de-4f79-a3a4-f29511517f13 req-754591e6-9edf-45fc-8bcd-7386ecf456b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "name": "network-vif-plugged", "status": "completed", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:36.610201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-a8a05e83-d5de-4f79-a3a4-f29511517f13 req-754591e6-9edf-45fc-8bcd-7386ecf456b0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.610958 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-a8a05e83-d5de-4f79-a3a4-f29511517f13 req-754591e6-9edf-45fc-8bcd-7386ecf456b0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.625968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-a8a05e83-d5de-4f79-a3a4-f29511517f13 req-754591e6-9edf-45fc-8bcd-7386ecf456b0 service nova] Creating event network-vif-plugged:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:31:36.631885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-a8a05e83-d5de-4f79-a3a4-f29511517f13 req-754591e6-9edf-45fc-8bcd-7386ecf456b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035593 Jun 21 18:31:36.633244 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 278/548] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:36.639072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:36.641242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:36.647046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.648855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.649881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.650418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.659735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:36.675499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-799f4a24-0273-407b-b71f-8a00768d2c06 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.232323 Jun 21 18:31:36.675499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 271/549] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:36 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:36.714412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c501fb00-3bf7-4e2b-b048-c18e099edbc1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079366 Jun 21 18:31:36.715404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 279/550] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:31:36 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:37.198309 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:37.200107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:37.209083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.209527 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.211229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.212577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.380784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:37.391242 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-44861dc6-bbe5-4b03-aead-d5054e47bae0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.198240 Jun 21 18:31:37.391930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 272/551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:37 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:37.463912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:37.464626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:37.471701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.472456 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.473296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.473709 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.643846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:37.657324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ee38702c-eee8-461b-ae11-883a50b6d12c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.197466 Jun 21 18:31:37.658381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 280/552] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:37 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:37.697079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:37.697690 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:37.704624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.705076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.705857 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.706296 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.727984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:37.730251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:37.740309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.741195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.748079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.748766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.793735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c2a357ef-561f-4cf4-8a6d-1a02c69ef92d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070717 Jun 21 18:31:37.794406 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 281/553] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:31:37 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:37.901725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:37.915048 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2ad7d97d-90c0-445b-b38c-c3f807edeb71 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.222296 Jun 21 18:31:37.916055 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 273/554] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:37 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:38.410616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.411327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.418606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.419496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.420056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.420723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.574330 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:38.585914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-10f6e559-b880-4ca7-a586-c52610df169a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.177291 Jun 21 18:31:38.585914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 282/555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:38.650409 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-c91e472b-1e6f-48b8-aa84-52e5afa5d0d0 req-bc452a8a-cc86-418d-8cdd-81f2ea1b5326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "name": "network-vif-plugged", "status": "completed", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:38.659212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c91e472b-1e6f-48b8-aa84-52e5afa5d0d0 req-bc452a8a-cc86-418d-8cdd-81f2ea1b5326 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.659825 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-c91e472b-1e6f-48b8-aa84-52e5afa5d0d0 req-bc452a8a-cc86-418d-8cdd-81f2ea1b5326 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.671752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-c91e472b-1e6f-48b8-aa84-52e5afa5d0d0 req-bc452a8a-cc86-418d-8cdd-81f2ea1b5326 service nova] Creating event network-vif-plugged:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:31:38.676513 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-c91e472b-1e6f-48b8-aa84-52e5afa5d0d0 req-bc452a8a-cc86-418d-8cdd-81f2ea1b5326 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031033 Jun 21 18:31:38.677103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 274/556] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:38.684225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.684901 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.691102 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.691549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.692315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.692775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.808909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.809974 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.816611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.817063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.817840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.818270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.845733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:38.861388 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5202d5d6-8b7b-4687-988f-cc43194bb939 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.181007 Jun 21 18:31:38.862848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 283/557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:38.874667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c6cf56bb-dbf4-4870-a38f-1ebf2e12cc7c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070673 Jun 21 18:31:38.875816 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 275/558] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:31:38.938275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.939027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.946978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.947599 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.948721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.949124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.967046 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.967749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.975677 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.976430 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.977330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.978123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.024428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:31:39.158596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:39.168004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4319f2fc-b8ed-4529-9cd5-d7b0539e3f61 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1356 microversion: 2.1 time: 0.234890 Jun 21 18:31:39.169046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 284/559] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:39.479413 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6c429c61-709b-49f3-bd58-b2f7cd1b3a0d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 204 len: 0 microversion: 2.1 time: 0.516181 Jun 21 18:31:39.480143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 276/560] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:31:38 2022] DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:31:39.489435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:39.489973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:39.497360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.497808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.498596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.499055 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.604471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:39.605189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:39.612161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.612641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.613435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.613874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.657371 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:39.667728 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f8e5c05f-08ee-4c0d-87ff-ff372c487994 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1681 microversion: 2.1 time: 0.182421 Jun 21 18:31:39.668366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 285/561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:39 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:39.791355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:39.803240 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-732eccaa-0225-4eb0-8443-561b54f30578 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.203335 Jun 21 18:31:39.804491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 277/562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:39 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:39.882407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:39.883239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:39.890858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.891476 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.892448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.893113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.056271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.064356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-887fb413-4b80-48b7-9515-a985d67d941c tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.186992 Jun 21 18:31:40.064981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 286/563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:39 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:40.185971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.186592 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.193687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.194331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.195134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.195572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.346962 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.356207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cd659717-cbe2-4933-a2cf-38e7e6636eb3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1546 microversion: 2.1 time: 0.174087 Jun 21 18:31:40.356835 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 278/564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:40.373515 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.374192 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.381165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.381634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.382470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.382916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.550577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.558963 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-705070ed-7350-4a85-98c3-296e901620e3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1546 microversion: 2.1 time: 0.189619 Jun 21 18:31:40.559564 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 287/565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:40.576167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.580439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.581338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Searching by: {'deleted': False, 'project_id': '1a1786032e9449728e36f679515ced6d'} {{(pid=118472) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 18:31:40.590024 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.590543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.591395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.591877 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.690225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.691342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.691995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.multi_cell_list [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118472) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 18:31:40.702894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.703672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.705002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.705784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.800208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3355291a-bfe0-47fb-9526-e12f4b00b2fd tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.228521 Jun 21 18:31:40.800950 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 279/566] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers => generated 341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:40.812651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.813272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.820588 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.821310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.821838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.822282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.927911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.940554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-17ea6888-f945-4341-9488-3c774a14984c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1681 microversion: 2.1 time: 0.257407 Jun 21 18:31:40.941103 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 288/567] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:40.947581 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.948411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.958606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.960124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.960985 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.961654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:41.006754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:41.016747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c5e2e4d3-d881-4335-b9e4-7060141d7f5b tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1546 microversion: 2.1 time: 0.207914 Jun 21 18:31:41.017683 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 280/568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:41.087028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:41.088357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:41.100500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.101136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:41.102478 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.103251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:41.109245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:41.173820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:41.187758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8c18fb8a-d5a2-40c4-a1bb-764ece34cfdd tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.245261 Jun 21 18:31:41.188818 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 289/569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:41.300933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:41.310586 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-40d12f97-2870-4385-b9c9-c85e51d13e97 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1261 microversion: 2.1 time: 0.231594 Jun 21 18:31:41.311284 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 281/570] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:41 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:41.970774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:41.971809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:41.984191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.985554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:41.986872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.987649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.182098 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.193008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9e2c37db-2db9-49b4-bfed-59d3c39f1eaf tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1681 microversion: 2.1 time: 0.229883 Jun 21 18:31:42.193589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 290/571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:41 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:42.218790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:42.219973 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:42.231926 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.232667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.233624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.234282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.330929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:42.331461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:42.333737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:42.340593 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.341236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.342378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.343082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.550157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.562050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.564326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:42.567363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6e8ef044-45ab-4eb1-948b-4a079356e34a tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.356148 Jun 21 18:31:42.568853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 282/572] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:42 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:42.570816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3588d3e6-a069-49bf-a9b7-5c9dbfea6069 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1446 microversion: 2.1 time: 0.244433 Jun 21 18:31:42.571397 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 291/573] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:42 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:42.602837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:42.603408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:42.610090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.612812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.612812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.612812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.117832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:43.134852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5f47cb81-980e-4eee-8527-9f3219578d52 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1446 microversion: 2.1 time: 0.536043 Jun 21 18:31:43.136457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 283/574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:42 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1446 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:43.155031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a479647-65ad-4c78-b98f-b67f280f5130"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:43.157350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:43.172085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.172473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.174085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.175047 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.217553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:43.222072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:43.235829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.237247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.238935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.240198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.372662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:43.388663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-beb0a100-8ce8-4b75-b9f5-468ae539aa9f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1614 microversion: 2.1 time: 0.179029 Jun 21 18:31:43.399469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 284/575] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:43 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1614 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:43.527827 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fb0584ad-0419-4787-b831-25e0e7821d0f req-09e64e82-734e-4423-b4dc-1ac09c5105e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6b7d00-7d63-4188-a97f-783156275509", "name": "network-vif-deleted", "tag": "06a0d32e-021c-4849-a7d1-7e11d1247848"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:43.547923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fb0584ad-0419-4787-b831-25e0e7821d0f req-09e64e82-734e-4423-b4dc-1ac09c5105e5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.549590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fb0584ad-0419-4787-b831-25e0e7821d0f req-09e64e82-734e-4423-b4dc-1ac09c5105e5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.566609 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fb0584ad-0419-4787-b831-25e0e7821d0f req-09e64e82-734e-4423-b4dc-1ac09c5105e5 service nova] Creating event network-vif-deleted:06a0d32e-021c-4849-a7d1-7e11d1247848 for instance db6b7d00-7d63-4188-a97f-783156275509 on hv-cinder-83124 Jun 21 18:31:43.583380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fb0584ad-0419-4787-b831-25e0e7821d0f req-09e64e82-734e-4423-b4dc-1ac09c5105e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054547 Jun 21 18:31:43.583380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 285/576] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:43.589689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:43.590650 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:43.599004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.600821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.602459 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.603017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.923409 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:43.940806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7ad8b3e3-164f-4244-bb08-ea6967326ba5 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.357196 Jun 21 18:31:43.948963 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 286/577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:43 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:44.413567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:44.418824 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:44.431354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:44.432533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:44.434325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:44.435146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:44.457628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e1fa7a20-977b-40c1-a984-31f87b10eb76 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.311165 Jun 21 18:31:44.461922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 292/578] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:31:43 2022] POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments => generated 194 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:44.511473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:44.512028 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:44.512741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'fault' on Instance uuid db6b7d00-7d63-4188-a97f-783156275509 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:44.573276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:44.587396 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8c618c45-c009-4012-8b37-ca3eb53afa15 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 200 len: 1331 microversion: 2.1 time: 0.183754 Jun 21 18:31:44.598075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 287/579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:44 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 1331 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:44.971511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:44.972238 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:44.980342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:44.980835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:44.981846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.005053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.272827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:45.286483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b8bc9c38-c5d9-47b9-8dc2-8c719a90d20d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.320562 Jun 21 18:31:45.287345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 293/580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:44 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:45.616616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:45.622708 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:45.622708 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:45.626946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.627545 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.629033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.629620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.649232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 HTTP/1.1 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:31:45.651637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:31:45.654659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'db6b7d00-7d63-4188-a97f-783156275509'} Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:45.656105 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:31:45.658359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:45.660856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:45.660856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5ad0d399-116d-4d28-bf2a-457182cf407f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 404 len: 111 microversion: 2.1 time: 0.042557 Jun 21 18:31:45.660856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 288/581] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:45 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:31:45.664629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e27638b4-d07b-4b86-a9d2-c764084418da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '.version_select at 0x7fd39c226ca0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:45.773072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e27638b4-d07b-4b86-a9d2-c764084418da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980827203" status: 202 len: 0 microversion: 2.1 time: 0.112151 Jun 21 18:31:45.773755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 294/582] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980827203 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:31:46.314034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:46.315235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:46.327730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.328509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:46.335839 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.335839 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:46.536350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:46.546934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-981e3698-f542-40e9-b161-0202c8736fd9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.239999 Jun 21 18:31:46.549837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 289/583] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:46 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:47.065062 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-736a35ec-987b-4837-a73a-a17a6e1cfa0b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: .version_select at 0x7fd39c07e1f0>, body: {"keypair": {"name": "tempest-keypair-788078337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwnQUc1jTWCZHARWBke9i39SvD3UYGrUFjvBNXarcs9T8bFxEJ/491fM9ZQXKgcMAD5zoVkG6tEzmnoxWxFpxePPisF44SK0wdX1N4TxzIIV4PG+0jQ5uQrjx+pveyihQ=="}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:47.105440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-736a35ec-987b-4837-a73a-a17a6e1cfa0b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:47.116421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-736a35ec-987b-4837-a73a-a17a6e1cfa0b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:47.121476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-d4b45799-eab3-441c-8710-5e64fe2f07b5 req-9ce8160a-07c5-4f8c-bc6d-f00b6043e6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:47.131595 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d4b45799-eab3-441c-8710-5e64fe2f07b5 req-9ce8160a-07c5-4f8c-bc6d-f00b6043e6f5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:47.132604 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d4b45799-eab3-441c-8710-5e64fe2f07b5 req-9ce8160a-07c5-4f8c-bc6d-f00b6043e6f5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:47.145890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-d4b45799-eab3-441c-8710-5e64fe2f07b5 req-9ce8160a-07c5-4f8c-bc6d-f00b6043e6f5 service nova] Creating event network-changed:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:31:47.151814 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-d4b45799-eab3-441c-8710-5e64fe2f07b5 req-9ce8160a-07c5-4f8c-bc6d-f00b6043e6f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034629 Jun 21 18:31:47.153224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 290/584] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:47.275832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-736a35ec-987b-4837-a73a-a17a6e1cfa0b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.219295 Jun 21 18:31:47.277007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 295/585] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:31:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:47.568050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:47.569801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:47.576709 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:47.577185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:47.577989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:47.578438 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:47.853500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:47.863014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b035383e-579b-4ee4-847d-4cdc076f61b7 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.299464 Jun 21 18:31:47.863613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 291/586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:47 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:48.894409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:48.895134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:48.905754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.906559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:48.908072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.908885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:49.289018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:49.297907 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2b31a804-bd0c-4c6c-9ee8-157f373f3c94 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.411584 Jun 21 18:31:49.298508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 296/587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:48 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:50.316184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:50.316891 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:50.324327 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.324799 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.325589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.326021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.516378 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:50.526322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-14c5a1e9-8191-467e-9d18-db740f431cb6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.214131 Jun 21 18:31:50.526915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 292/588] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:50 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:50.560854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1433439357", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89bb927a-5407-4745-a764-78e1bdbbf5fe"}], "security_groups": [{"name": "tempest-securitygroup--1150594202"}], "key_name": "tempest-keypair-788078337", "user_data": "}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:50.681416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] validate_networks() for [('89bb927a-5407-4745-a764-78e1bdbbf5fe', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:31:51.167642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:31:51.168251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:31:51.168957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:31:51.169580 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:31:51.170435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:31:51.182628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.183132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.184195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.185617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.211593 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:51.216986 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:51.231758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:31:51.234226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:31:51.249428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.250164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.256016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:51.261742 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.262704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.263801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.264361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.307336 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2e5e1b4c-4713-48a8-a82f-ded8d9c05df0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments/f2fb590b-49ab-4e8a-8e27-39b78b7f89ec" status: 200 len: 194 microversion: 2.20 time: 0.062677 Jun 21 18:31:51.308125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 293/589] 10.222.0.23 () {60 vars in 1453 bytes} [Tue Jun 21 18:31:51 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments/f2fb590b-49ab-4e8a-8e27-39b78b7f89ec => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:31:51.383038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.383038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.390197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.390649 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.391437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.391874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.407457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-22b617d6-cc66-49aa-92cb-6042c926a98d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850948 Jun 21 18:31:51.409328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 297/590] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:31:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:31:51.420354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-724fb5c6-7a47-448a-a78b-a919a4446d3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.421276 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-724fb5c6-7a47-448a-a78b-a919a4446d3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.485176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-724fb5c6-7a47-448a-a78b-a919a4446d3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:51.499593 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-724fb5c6-7a47-448a-a78b-a919a4446d3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1241 microversion: 2.1 time: 0.083380 Jun 21 18:31:51.501034 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 298/591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:51 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:51.547995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.549445 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.561159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.562167 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.563326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.564119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.598157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lazy-loading 'services' on Instance uuid 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:51.788849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:51.797541 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9799f1a4-3144-45c5-a615-661834f541bb tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.256702 Jun 21 18:31:51.798133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 299/592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:51 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:51.964730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c970b963-aa2a-4241-ae8a-67f6e1c0140c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments/f2fb590b-49ab-4e8a-8e27-39b78b7f89ec" status: 202 len: 0 microversion: 2.20 time: 0.587979 Jun 21 18:31:51.965322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 294/593] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jun 21 18:31:51 2022] DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments/f2fb590b-49ab-4e8a-8e27-39b78b7f89ec => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:31:51.974457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.975948 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.982506 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.982960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.983965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.984413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:52.045509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f44aa7fe-2415-4913-ac59-59d4ff452ba8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074674 Jun 21 18:31:52.046680 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 300/594] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:31:51 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:31:52.520162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3b894945-ce0c-49ce-87d1-195ec7d8a5ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:52.520890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3b894945-ce0c-49ce-87d1-195ec7d8a5ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:52.589853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3b894945-ce0c-49ce-87d1-195ec7d8a5ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:52.596886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3b894945-ce0c-49ce-87d1-195ec7d8a5ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1241 microversion: 2.1 time: 0.081311 Jun 21 18:31:52.597469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 295/595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:52 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:52.815403 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:52.816023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:52.823884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:52.824343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:52.825206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:52.825657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:52.969754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:52.981609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a08ccd60-f1a6-4258-ab2c-b8cdfed7bfb8 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.170069 Jun 21 18:31:52.982228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 301/596] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:52 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:53.066414 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:53.067214 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:53.075348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.075943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.076905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.077349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.116296 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-afe30980-4680-40fe-8559-bb8c39aa4b13 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053606 Jun 21 18:31:53.117238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 296/597] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:31:53 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:31:53.614920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:53.615457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:53.622758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.623205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.624000 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.624481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.693816 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:53.703123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ab737c6b-8d4e-4fff-90f5-9868fb651606 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1237 microversion: 2.1 time: 0.092546 Jun 21 18:31:53.703791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 302/598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:53 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:54.001568 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:54.002192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:54.013229 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.014132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.015224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.015764 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.134163 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:54.135934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:54.146886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.147711 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.149351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.150423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.180436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:54.191870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d0df57fb-0643-4adf-ade3-c8ce1eb84cd4 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1734 microversion: 2.1 time: 0.194387 Jun 21 18:31:54.192533 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e12a67ba-e6d6-44ef-81b5-dbf19ed0d2ef tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066698 Jun 21 18:31:54.192942 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 297/599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:53 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:54.193314 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 303/600] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:31:54 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:31:54.480276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:54.481074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:54.489789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.490659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.492380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.493009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.698487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:54.707658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ee71689f-af8f-4300-ae9f-692cf21fdf1a tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1592 microversion: 2.1 time: 0.233856 Jun 21 18:31:54.708239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 298/601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:54 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1592 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:54.723470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:54.724418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:54.743569 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.744522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.745536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.753570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.865950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:54.875693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-050024ff-6587-43d5-ae8c-65f31ac28eec tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1293 microversion: 2.1 time: 0.157120 Jun 21 18:31:54.876627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 304/602] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:54 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:55.210036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:55.212033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.216910 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:55.217953 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.219655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.220177 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.221057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.221566 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.230681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.231490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.233577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.234383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.252561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:55.285635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-409ae088-7330-4725-b404-156c065f2fb8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054230 Jun 21 18:31:55.285635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 299/603] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:31:55 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:31:55.456713 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:55.468879 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9db8b27f-ad6a-445c-a898-08dd824f08b0 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1714 microversion: 2.1 time: 0.260511 Jun 21 18:31:55.470440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 305/604] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:55 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1714 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:55.651177 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:55.651880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.659209 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.659733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.660577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.661224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.793717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] HTTP exception thrown: Cannot 'detach_volume' instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e while it is in vm_state rescued Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Request method failure captured: Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments/5a40ba7a-b8e4-429e-81af-1b5a8332d8f7 HTTP/1.1 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2HublXDJAIGwn0eNOGwP1YcsFgcFZEKXYyC2wd2NgCaRgL9K5yqzOiUDINHuJeDP_GebOwDuGO3yydvRBwCIsj9DyjTGZt6loXQhr_81XvbIJ34MHdvvPwEHXNLUzv1FrMZiBQc-5mPGxS_7wLGXXfVghHMVu2SFgtPiZve3-htV4 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:31:55.795737 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 59f011e91b684e1288dad5f0ac733c0f Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:31:55.799090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Cannot 'detach_volume' instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e while it is in vm_state rescued Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'server_id': '2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e', 'id': '5a40ba7a-b8e4-429e-81af-1b5a8332d8f7'} Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:55.800584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e while it is in vm_state rescued Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e while it is in vm_state rescued Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:31:55.802563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Returning 409 to user: Cannot 'detach_volume' instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e while it is in vm_state rescued {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:55.805188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7705eaf2-fa31-4022-a961-5bdd613d06f6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments/5a40ba7a-b8e4-429e-81af-1b5a8332d8f7" status: 409 len: 152 microversion: 2.1 time: 0.152315 Jun 21 18:31:55.805188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 300/605] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:31:55 2022] DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments/5a40ba7a-b8e4-429e-81af-1b5a8332d8f7 => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 21 18:31:55.810648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:55.811496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.820285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.820954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.821831 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.822367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.901532 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:55.902257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.909896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.910447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.911333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.911850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.039697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:56.050929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-39adadca-29af-4a2d-8543-9d4e60c92089 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1311 microversion: 2.1 time: 0.153916 Jun 21 18:31:56.062261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 301/606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:55 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:56.166508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b4b7075c-1d5c-4ca0-a6b5-471bb4b4db55 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.360744 Jun 21 18:31:56.167283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 306/607] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:31:55 2022] POST /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:31:56.175807 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:56.177023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:56.184770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.185217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.186001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.186439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.272549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:56.273790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:56.282252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.283011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.284148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.284739 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.326606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5778968c-1555-408f-bb7d-d3abd3b160bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060246 Jun 21 18:31:56.327589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 307/608] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:31:56 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:56.469088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:56.469800 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:56.478745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.479766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.480887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.481562 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.526783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:31:56.603338 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:56.685617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:56.706573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a6009f8b-7289-4f62-842c-74246e7c3eaf tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1722 microversion: 2.1 time: 0.533356 Jun 21 18:31:56.708863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 302/609] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:56 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1722 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:56.955611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-29477f9c-5e0c-4722-b2f0-8f140d625768 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 204 len: 0 microversion: 2.20 time: 0.490730 Jun 21 18:31:56.957164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 308/610] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jun 21 18:31:56 2022] DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 21 18:31:56.968458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:56.969530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:56.977224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.977659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.978640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.979377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:57.090506 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:57.098220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:57.111519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:57.112476 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:57.113987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:57.114793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:57.273720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:57.291101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:57.294471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:57.296980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bfa8e824-a1f1-422a-bda6-6ff00b0ca406 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.332084 Jun 21 18:31:57.297906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 303/611] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:56 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:31:57.590472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:57.606023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-834d1731-9fdd-4a23-a1a0-6673601a400b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1299 microversion: 2.1 time: 0.530792 Jun 21 18:31:57.607324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 309/612] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:57 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1299 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:57.732423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:57.734746 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:57.743263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:57.743766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:57.744670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:57.745115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.268612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:58.279125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-25b90f74-2f64-4928-a9a8-c3b78a3a331d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1722 microversion: 2.1 time: 0.551675 Jun 21 18:31:58.280371 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 304/613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:57 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1722 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:58.318912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:58.320292 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:58.328995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.329664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.330665 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.331289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.629537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:58.631572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:58.643570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.644853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.646375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.647225 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.668509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:58.690347 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:58.692572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:58.694386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-65dcb239-b243-4f46-9325-ec9e036ef70d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1725 microversion: 2.20 time: 0.379574 Jun 21 18:31:58.695428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 310/614] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:58 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:31:59.262186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.277998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b02fc020-5dbb-4901-a6f8-e1c28cfdfe54 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.655846 Jun 21 18:31:59.296596 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 305/615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:58 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:59.305240 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:59.307176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:59.322659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.323450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.324366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.324764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.580594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b2d18d18-e88a-447c-97c7-3e95541988a3 req-dfd21477-8eb8-4f66-8e5c-6c092ccccfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:59.591041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b2d18d18-e88a-447c-97c7-3e95541988a3 req-dfd21477-8eb8-4f66-8e5c-6c092ccccfa4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.592179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b2d18d18-e88a-447c-97c7-3e95541988a3 req-dfd21477-8eb8-4f66-8e5c-6c092ccccfa4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.609248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b2d18d18-e88a-447c-97c7-3e95541988a3 req-dfd21477-8eb8-4f66-8e5c-6c092ccccfa4 service nova] Creating event network-changed:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:31:59.619694 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b2d18d18-e88a-447c-97c7-3e95541988a3 req-dfd21477-8eb8-4f66-8e5c-6c092ccccfa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043343 Jun 21 18:31:59.620355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 306/616] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:59.689712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.707525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7bfe361e-fc17-4d5a-91f5-694c4cc40582 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1722 microversion: 2.1 time: 0.409350 Jun 21 18:31:59.712562 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 311/617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:59 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1722 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:59.726515 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:59.727584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:59.735422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.735521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.744075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.744696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.905279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.920784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.925765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.927439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d90ad48f-1474-4d4f-b8fa-eee4237a0216 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1658 microversion: 2.20 time: 0.206143 Jun 21 18:31:59.929082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 307/618] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:31:59 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1658 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:32:00.306775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:00.307545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:00.319215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.324099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.325304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.325930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.435715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-610624ee-c685-4e88-b225-d8652a8ef30f req-bc3b8b42-0eab-492b-a050-395b77e25095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9085b7c8-6dc8-496a-8611-b3e18c5f2e69", "name": "network-vif-deleted", "tag": "45918f8a-911b-45c3-9e77-68ef5472ad43"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:00.469189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-610624ee-c685-4e88-b225-d8652a8ef30f req-bc3b8b42-0eab-492b-a050-395b77e25095 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.472829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-610624ee-c685-4e88-b225-d8652a8ef30f req-bc3b8b42-0eab-492b-a050-395b77e25095 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.516042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-610624ee-c685-4e88-b225-d8652a8ef30f req-bc3b8b42-0eab-492b-a050-395b77e25095 service nova] Creating event network-vif-deleted:45918f8a-911b-45c3-9e77-68ef5472ad43 for instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 on hv-cinder-83124 Jun 21 18:32:00.529427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-610624ee-c685-4e88-b225-d8652a8ef30f req-bc3b8b42-0eab-492b-a050-395b77e25095 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104841 Jun 21 18:32:00.530163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 308/619] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:00.734909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:00.735614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:00.763041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.763487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.771931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.772976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.816887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:00.836887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e811f0d2-cc10-449d-a22a-3eba584ee4b0 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.526129 Jun 21 18:32:00.836887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 312/620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:00 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:00.971489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:00.975549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:00.999699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.000612 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.001860 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.002472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.144723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:01.166448 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:01.169858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:01.171558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5feea3bc-322e-476a-b28d-4c74c5d10937 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 200 len: 1658 microversion: 2.20 time: 0.214672 Jun 21 18:32:01.191133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:01.196684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 313/621] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:00 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 1658 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:32:01.204127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f4411c62-0c7a-4121-adc6-fdd2155c1e53 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1728 microversion: 2.1 time: 0.477051 Jun 21 18:32:01.205261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 309/622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:00 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1728 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:01.221386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:01.222054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:01.228657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:01.230566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.231126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.232017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.232584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.344183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-83478ffe-596e-4f2e-a52e-167d6e0ad589 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126240 Jun 21 18:32:01.353874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 314/623] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:32:01 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:01.653064 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-84db6a5d-b58e-4aa0-abf9-6ed8df79ae4d req-02151c73-5800-411d-8e59-4631033b25c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea73404-9343-4057-868c-7ee3c41c736d", "tag": "a5b5eaff-fa4c-463e-ba6c-1c8709124a94"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:01.665547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-84db6a5d-b58e-4aa0-abf9-6ed8df79ae4d req-02151c73-5800-411d-8e59-4631033b25c3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.667764 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-84db6a5d-b58e-4aa0-abf9-6ed8df79ae4d req-02151c73-5800-411d-8e59-4631033b25c3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.680665 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-84db6a5d-b58e-4aa0-abf9-6ed8df79ae4d req-02151c73-5800-411d-8e59-4631033b25c3 service nova] Creating event network-changed:a5b5eaff-fa4c-463e-ba6c-1c8709124a94 for instance 5ea73404-9343-4057-868c-7ee3c41c736d on hv-cinder-83124 Jun 21 18:32:01.686795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-84db6a5d-b58e-4aa0-abf9-6ed8df79ae4d req-02151c73-5800-411d-8e59-4631033b25c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037542 Jun 21 18:32:01.687413 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 310/624] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:01.855249 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:01.855965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:01.877031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=12 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:01.878991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.879450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.880258 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:01.880742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:02.160367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:02.173168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b9972a89-bb7a-4787-9346-feba8fbf6100 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.322091 Jun 21 18:32:02.174481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 315/625] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:01 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:02.204247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:02.205869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:02.234404 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:02.235273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:02.236771 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:02.237627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:02.265525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 HTTP/1.1 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:32:02.268794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:32:02.272499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '9085b7c8-6dc8-496a-8611-b3e18c5f2e69'} Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:32:02.273464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:32:02.275036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:02.277982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:32:02.277982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-14a202f1-5b5a-4396-acba-1de00126d818 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 404 len: 111 microversion: 2.20 time: 0.074483 Jun 21 18:32:02.277982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 311/626] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:02 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:32:02.284145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-793d4063-0e1c-4bb4-a330-1ac84a1b58c8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '.version_select at 0x7fd39c173b80>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:02.386057 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-793d4063-0e1c-4bb4-a330-1ac84a1b58c8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433878041" status: 204 len: 0 microversion: 2.20 time: 0.105588 Jun 21 18:32:02.387652 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 316/627] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Jun 21 18:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433878041 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 18:32:03.027393 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-bd39dd7b-1c0a-4fb1-aefd-59700836d81b req-f252d758-d69a-45c1-92c2-4130bef957a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:03.047634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:03.051901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bd39dd7b-1c0a-4fb1-aefd-59700836d81b req-f252d758-d69a-45c1-92c2-4130bef957a8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:03.054395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-bd39dd7b-1c0a-4fb1-aefd-59700836d81b req-f252d758-d69a-45c1-92c2-4130bef957a8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:03.093241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-bd39dd7b-1c0a-4fb1-aefd-59700836d81b req-f252d758-d69a-45c1-92c2-4130bef957a8 service nova] Creating event network-changed:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:32:03.099722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-bd39dd7b-1c0a-4fb1-aefd-59700836d81b req-f252d758-d69a-45c1-92c2-4130bef957a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079702 Jun 21 18:32:03.100352 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 312/628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:03.200998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:03.204100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:03.219491 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:03.220983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:03.223117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:03.224354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:03.466998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:03.477190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-852eb05e-e4b6-4ba3-9db0-f65a9e9e1a5c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.286949 Jun 21 18:32:03.478339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 317/629] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:03 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:04.332006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a82860fd-97ec-478c-b993-d46bdfd29b90 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: .version_select at 0x7fd396f2c1f0>, body: {"keypair": {"name": "tempest-keypair-175662366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWZaxE0YB3UC0ggXa9m3DvVzBYtLppvQxL+z/nhtmMt1yTeMAtVXBcD/ikVdsPg5IOMS+kqrHMV7KSxlsP4wckjIX7BxI9xJn7YsNVQJninGecGhWGdxVZybJ64imUn1Q=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:04.362691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a82860fd-97ec-478c-b993-d46bdfd29b90 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:32:04.375338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a82860fd-97ec-478c-b993-d46bdfd29b90 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for user e03c3a73166b4bbe9fca6d18ecf59221 and project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:32:04.473517 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a82860fd-97ec-478c-b993-d46bdfd29b90 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.149541 Jun 21 18:32:04.474132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 313/630] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Jun 21 18:32:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 18:32:04.507246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:04.507246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:04.531962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:04.534076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:04.547296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:04.547296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:04.757552 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:04.766383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c9b65bcf-c60a-4d71-9d1f-10309953a59c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.274757 Jun 21 18:32:04.766991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 318/631] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:04 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:05.124940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-a963b2da-ae54-4e9c-be5d-3a80e8092b36 req-a1a7f792-c315-4714-9ba1-c4409259d814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:05.141335 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a963b2da-ae54-4e9c-be5d-3a80e8092b36 req-a1a7f792-c315-4714-9ba1-c4409259d814 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.142169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a963b2da-ae54-4e9c-be5d-3a80e8092b36 req-a1a7f792-c315-4714-9ba1-c4409259d814 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.166493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-a963b2da-ae54-4e9c-be5d-3a80e8092b36 req-a1a7f792-c315-4714-9ba1-c4409259d814 service nova] Creating event network-changed:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:32:05.177826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-a963b2da-ae54-4e9c-be5d-3a80e8092b36 req-a1a7f792-c315-4714-9ba1-c4409259d814 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059039 Jun 21 18:32:05.177826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 314/632] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:05.278518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1571813508"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:05.279381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:05.289256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.289695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.290706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.291445 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.685623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.network.security_group_api [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Adding security group a4a1ee2f-2ddc-40d0-a513-fb6211218c91 to port 839a5a4d-fb74-4118-bb14-b344123ac80c Jun 21 18:32:05.789326 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-cb0b7603-c179-4d68-9fd7-13a162798ba2 req-02e2f79d-64bf-4fac-b74f-9e2be584e089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea73404-9343-4057-868c-7ee3c41c736d", "name": "network-vif-plugged", "status": "completed", "tag": "a5b5eaff-fa4c-463e-ba6c-1c8709124a94"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:05.808218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cb0b7603-c179-4d68-9fd7-13a162798ba2 req-02e2f79d-64bf-4fac-b74f-9e2be584e089 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.809375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-cb0b7603-c179-4d68-9fd7-13a162798ba2 req-02e2f79d-64bf-4fac-b74f-9e2be584e089 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.835494 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-cb0b7603-c179-4d68-9fd7-13a162798ba2 req-02e2f79d-64bf-4fac-b74f-9e2be584e089 service nova] Creating event network-vif-plugged:a5b5eaff-fa4c-463e-ba6c-1c8709124a94 for instance 5ea73404-9343-4057-868c-7ee3c41c736d on hv-cinder-83124 Jun 21 18:32:05.845721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-cb0b7603-c179-4d68-9fd7-13a162798ba2 req-02e2f79d-64bf-4fac-b74f-9e2be584e089 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069751 Jun 21 18:32:05.847115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 315/633] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:05.864502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:05.864502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:05.875183 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.876010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.877775 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.878454 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:06.117297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:06.132146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1e6d77e8-b35b-4f3a-a8ac-9ea3b798ff3f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.282758 Jun 21 18:32:06.133558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 316/634] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:05 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:06.922706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1760efe8-5a9e-47ef-8259-da61870dc7a7 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action" status: 202 len: 0 microversion: 2.1 time: 1.650169 Jun 21 18:32:06.930232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 319/635] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:32:05 2022] POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action => generated 0 bytes in 1653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:32:06.934524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:06.935289 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:06.943946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:06.945878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:06.947175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:06.948828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.155849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:07.164383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:07.178026 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:07.179910 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.181145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:07.182005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.313724 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:07.324835 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2c556485-8a54-4207-810f-9905cd91be27 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1757 microversion: 2.1 time: 0.394199 Jun 21 18:32:07.325637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 317/636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:06 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1757 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:07.330763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-53dfb148-5648-4f0c-b81d-7e08295e5697 req-9d0e8339-5013-45db-acbb-46963cd94c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:07.352975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-53dfb148-5648-4f0c-b81d-7e08295e5697 req-9d0e8339-5013-45db-acbb-46963cd94c7a service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:07.354405 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-53dfb148-5648-4f0c-b81d-7e08295e5697 req-9d0e8339-5013-45db-acbb-46963cd94c7a service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.370802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:07.373589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-53dfb148-5648-4f0c-b81d-7e08295e5697 req-9d0e8339-5013-45db-acbb-46963cd94c7a service nova] Creating event network-changed:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:32:07.383345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-53dfb148-5648-4f0c-b81d-7e08295e5697 req-9d0e8339-5013-45db-acbb-46963cd94c7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054121 Jun 21 18:32:07.383345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 318/637] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:07.384725 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c4056b5b-cdcb-4b98-ade9-1ecc84501a07 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1367 microversion: 2.1 time: 0.232012 Jun 21 18:32:07.385529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 320/638] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:07 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:08.373312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1258772810", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6317d84-2f6b-44fa-b7b5-4146bb43cc39"}], "security_groups": [{"name": "tempest-securitygroup--648183816"}], "key_name": "tempest-keypair-175662366", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:08.406994 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:08.408846 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:08.422151 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.423142 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.424727 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.428270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.507719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] validate_networks() for [('a6317d84-2f6b-44fa-b7b5-4146bb43cc39', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:32:08.686984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:08.696968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-553138df-11db-45a7-bd14-acd2fd23c84e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1557 microversion: 2.1 time: 0.297461 Jun 21 18:32:08.708002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 321/639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:08 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1557 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:08.715145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:08.715652 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:08.717650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:08.722964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.723418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.724249 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.724806 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.825004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6f5a324a-4702-420c-b47c-035970eaaf82 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113970 Jun 21 18:32:08.826013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 322/640] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:32:08 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:09.057647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:32:09.058098 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:32:09.058604 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:32:09.059106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:32:09.059580 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:32:09.070090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:09.070539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:09.071429 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:09.071865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:09.091579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:32:09.096141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Getting quotas for user e03c3a73166b4bbe9fca6d18ecf59221 and project 227bb7e0aca249aea1d7bf2ecb2903e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:32:09.109311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:32:09.111700 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:32:09.247058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a875ad03-2111-494f-a88c-7bc51526e5bf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.883962 Jun 21 18:32:09.248463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 319/641] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Jun 21 18:32:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 18:32:09.263651 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:09.268656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:09.422766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:09.431063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:09.432919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:09.434086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-782e4db3-d711-4bc7-b241-18d7e83900c5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1281 microversion: 2.20 time: 0.178791 Jun 21 18:32:09.434655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 323/642] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:09 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:32:10.150977 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-0b653966-5398-48e5-9762-c11923619aa1 req-285b7f80-bf08-4414-aba6-af9361e37538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea73404-9343-4057-868c-7ee3c41c736d", "tag": "a5b5eaff-fa4c-463e-ba6c-1c8709124a94"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:10.169161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0b653966-5398-48e5-9762-c11923619aa1 req-285b7f80-bf08-4414-aba6-af9361e37538 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:10.169770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0b653966-5398-48e5-9762-c11923619aa1 req-285b7f80-bf08-4414-aba6-af9361e37538 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:10.181545 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-0b653966-5398-48e5-9762-c11923619aa1 req-285b7f80-bf08-4414-aba6-af9361e37538 service nova] Creating event network-changed:a5b5eaff-fa4c-463e-ba6c-1c8709124a94 for instance 5ea73404-9343-4057-868c-7ee3c41c736d on hv-cinder-83124 Jun 21 18:32:10.188243 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-0b653966-5398-48e5-9762-c11923619aa1 req-285b7f80-bf08-4414-aba6-af9361e37538 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045395 Jun 21 18:32:10.189928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 320/643] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:10.454782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:10.457606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:10.488775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:10.489974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:10.493974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:10.495063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:10.596569 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:10.620542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:10.620542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:10.620542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-186c0b97-ac35-4d54-9fff-5ebe4c13bdc4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1285 microversion: 2.20 time: 0.168386 Jun 21 18:32:10.620943 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 324/644] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:10 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:11.638601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:11.639569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:11.646134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.646660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:11.654455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.654455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:11.716159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:11.725085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:11.726614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:11.727752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dcd4d13b-6e97-4a27-a0fb-afb67ed94c9c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1333 microversion: 2.20 time: 0.094085 Jun 21 18:32:11.728328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 321/645] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:11 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:12.746363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:12.746989 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:12.754777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:12.755226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:12.756457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:12.756911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:13.021085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:13.036527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:13.039909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:13.041750 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7e101b10-91fb-4c22-a826-6f42191aefa4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1339 microversion: 2.20 time: 0.299242 Jun 21 18:32:13.042590 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 325/646] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:12 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:14.064866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:14.065635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:14.075799 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.076330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.077200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.077624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.219866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:14.228780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:14.241914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:14.242807 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-5ff92d57-4c7c-4915-ae44-4260b881ee36 req-d87cbe33-43f4-45f1-ab9e-0d5f3301c002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:14.243363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-58f9129c-4b33-4cf2-8d98-697e018784a8 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.183913 Jun 21 18:32:14.245207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 322/647] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:14 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:14.255499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-5ff92d57-4c7c-4915-ae44-4260b881ee36 req-d87cbe33-43f4-45f1-ab9e-0d5f3301c002 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.257164 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-5ff92d57-4c7c-4915-ae44-4260b881ee36 req-d87cbe33-43f4-45f1-ab9e-0d5f3301c002 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.269894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-5ff92d57-4c7c-4915-ae44-4260b881ee36 req-d87cbe33-43f4-45f1-ab9e-0d5f3301c002 service nova] Creating event network-changed:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:32:14.276374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-5ff92d57-4c7c-4915-ae44-4260b881ee36 req-d87cbe33-43f4-45f1-ab9e-0d5f3301c002 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040322 Jun 21 18:32:14.277374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 326/648] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:15.262267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:15.262848 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:15.269544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:15.280557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:15.280557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:15.280557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:15.409058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:15.417836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:15.419334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:15.420480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8bf21989-ddb5-4baa-8279-9542113adace tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.162224 Jun 21 18:32:15.421043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 323/649] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:15 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:16.438998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:16.439734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:16.447081 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.447536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.448314 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.448787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.585191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:16.593959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:16.595594 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:16.596849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6bc4eccf-7d76-4cf0-9e8f-7e1131e548de tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.162687 Jun 21 18:32:16.597410 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 327/650] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:16 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:17.677036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:17.677869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:17.679709 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:17.685096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.685535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:17.686359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.686741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:17.689587 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:17.834323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:17.843122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:17.844688 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:17.845867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-db6c47f2-c433-4ef6-b237-de41a4389c69 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.234463 Jun 21 18:32:17.846408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 324/651] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:17 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:18.865551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:18.866190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:18.873420 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:18.873868 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:18.874653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:18.875081 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:18.892951 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:19.027145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.035583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.037160 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.038485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ae6f1409-35ee-49c7-a051-a0d8b08fc7c7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.177377 Jun 21 18:32:19.039170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 328/652] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:18 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:19.306170 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:19.307684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:19.312717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:19.313829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:19.327407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.327863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.328691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.329135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.592280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-57b8ee56-6274-48d3-9f7e-0e77a0d3e9ff tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action" status: 202 len: 0 microversion: 2.1 time: 0.293018 Jun 21 18:32:19.594144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 325/653] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:32:19 2022] POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:32:19.605118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:19.606048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:19.609153 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:19.618823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.619637 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.621076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.621833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.765702 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-5e78d158-b765-4df5-8cd9-323fed072e41 req-5231767e-2122-4801-a7f7-0b9ea8bb4ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "name": "network-vif-plugged", "status": "completed", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:19.783611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5e78d158-b765-4df5-8cd9-323fed072e41 req-5231767e-2122-4801-a7f7-0b9ea8bb4ed3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.784383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5e78d158-b765-4df5-8cd9-323fed072e41 req-5231767e-2122-4801-a7f7-0b9ea8bb4ed3 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.807916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-5e78d158-b765-4df5-8cd9-323fed072e41 req-5231767e-2122-4801-a7f7-0b9ea8bb4ed3 service nova] Creating event network-vif-plugged:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:32:19.817222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-5e78d158-b765-4df5-8cd9-323fed072e41 req-5231767e-2122-4801-a7f7-0b9ea8bb4ed3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061920 Jun 21 18:32:19.818278 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 326/654] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:19.969415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.986381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-10c1d97c-0a5b-4adc-a6e9-a83e9d1919e8 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1749 microversion: 2.1 time: 0.386135 Jun 21 18:32:19.990524 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 329/655] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:19 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1749 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:20.058969 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:20.059810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:20.066935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.067546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.068369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.068918 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.310251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:20.325621 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:20.330174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:20.330174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4d79f2a1-61d4-42d9-8b80-b2c42d4d177c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.276391 Jun 21 18:32:20.330174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 327/656] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:20 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:21.011852 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:21.012461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:21.019638 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.020611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.021417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.021853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.201032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.216020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dbd7863e-995d-4257-9743-d09785e4bd08 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.208219 Jun 21 18:32:21.217187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 330/657] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:21 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:21.351866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:21.352854 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:21.359655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.360104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.360931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.361367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.510665 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.519252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.520826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.521949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-974ccd92-8817-495a-bb68-676db0d2dc79 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1406 microversion: 2.20 time: 0.176071 Jun 21 18:32:21.522579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 328/658] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:21 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:22.244097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:22.244809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:22.253467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.253920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.254713 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.255154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.416956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:22.431031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ca531b2a-67a6-4dfa-a6e7-176d9eff8bec tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.193679 Jun 21 18:32:22.431653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 331/659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:22 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:22.541631 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:22.542257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:22.550232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.550692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.551471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.551909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.702314 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:22.717162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:22.720128 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:22.722226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9bbcd5b2-92ff-4363-9b14-3790e29be5f7 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1598 microversion: 2.20 time: 0.185035 Jun 21 18:32:22.723185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 329/660] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:32:22 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:32:22.750923 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:22.751415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:22.758514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.758975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.759752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.760184 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.847364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1e6cec41-5d98-4ebd-a0d4-04a69898c697 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100352 Jun 21 18:32:22.847960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 332/661] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Jun 21 18:32:22 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:32:23.458663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:23.460009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:23.472355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:23.473195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:23.474490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:23.475280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:23.653618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:23.661941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1052aed2-b93f-473a-bc68-a2c74709b7dc tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.211059 Jun 21 18:32:23.662535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 330/662] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:23 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:23.940847 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-dd9f8941-2162-4904-98af-78a3ff9101ec req-6db59e3c-f331-49e9-aeb6-55c71e1361ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:23.949864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-dd9f8941-2162-4904-98af-78a3ff9101ec req-6db59e3c-f331-49e9-aeb6-55c71e1361ff service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:23.950427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-dd9f8941-2162-4904-98af-78a3ff9101ec req-6db59e3c-f331-49e9-aeb6-55c71e1361ff service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:23.961440 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-dd9f8941-2162-4904-98af-78a3ff9101ec req-6db59e3c-f331-49e9-aeb6-55c71e1361ff service nova] Creating event network-changed:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:32:23.966844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-dd9f8941-2162-4904-98af-78a3ff9101ec req-6db59e3c-f331-49e9-aeb6-55c71e1361ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030113 Jun 21 18:32:23.968087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 333/663] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:24.679728 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:24.685033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:24.692656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:24.693107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:24.693971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:24.694774 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:24.905507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:24.914319 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-378236b4-9cb4-4ba0-800a-a29be6725d02 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.238913 Jun 21 18:32:24.914915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 331/664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:24 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:25.932984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:25.933693 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:25.941032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.941479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:25.942255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.942684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:26.093703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:26.102882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9db8f06e-3dae-44d1-aa63-545d4fee4522 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.174741 Jun 21 18:32:26.103470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 334/665] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:25 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:27.120412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:27.121041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:27.127920 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:27.128375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:27.129194 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:27.129637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:27.295907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:27.304859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4f8ed34e-81db-448f-9626-31ab2ea7bd01 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.188450 Jun 21 18:32:27.305693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 332/666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:27 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:28.324374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:28.325147 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:28.332990 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.333487 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.334311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.334787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.497870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:28.506808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1238a1a2-c3f4-4387-8496-3324d290f989 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.187427 Jun 21 18:32:28.508659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 335/667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:28 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:29.525666 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:29.526228 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:29.532901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.533351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:29.534119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.534559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:29.696310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:29.704638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cec1810c-446c-44a5-86f6-ad57e44c21df tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.183628 Jun 21 18:32:29.705218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 333/668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:29 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:30.722213 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:30.722804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:30.730062 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:30.730511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:30.731274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:30.731712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:30.879734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:30.890075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ed6dd8bc-0783-4dd8-90bf-50b30bb71044 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.171591 Jun 21 18:32:30.893754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 336/669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:30 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:31.907838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:31.908485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:31.916603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.917057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:31.917836 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.918364 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:32.072658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:32.081169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1034ba13-f797-4ed1-bc1c-c5c5b2977529 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.177211 Jun 21 18:32:32.081749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 334/670] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:31 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:33.099395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:33.100017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:33.107266 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:33.107724 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:33.108553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:33.109004 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:33.276200 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:33.285463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-87d4cd44-c9a7-4400-b984-8b962eea958d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.190073 Jun 21 18:32:33.286052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 337/671] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:33 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:34.302563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:34.303180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:34.309769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:34.310227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:34.310988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:34.311425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:34.467569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:34.475655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0fe5e4b6-0e38-49be-a695-3164493ec647 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.176907 Jun 21 18:32:34.476234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 335/672] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:34 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:35.494785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:35.495445 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:35.502295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.502751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.503534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.503970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.657090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:35.665876 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9c700311-ac1c-4e17-9761-16fe7f5f2750 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.175793 Jun 21 18:32:35.666462 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 338/673] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:35 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:36.686713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:36.686713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:36.691395 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.691838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:36.692638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.693069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:36.842988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:36.852230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-90b8584c-bada-444c-a24c-15797e1035e6 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1754 microversion: 2.1 time: 0.172078 Jun 21 18:32:36.853529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 336/674] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:36 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:37.879958 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:37.880784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:37.889735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:37.890632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:37.891010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:37.891449 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.048496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:38.057775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-81e1089e-1085-4f5c-9a76-846c3d441f95 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1757 microversion: 2.1 time: 0.182127 Jun 21 18:32:38.058379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 339/675] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:37 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:44.192175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:44.192801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:44.201224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.201699 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.202480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.202909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.289189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'services' on Instance uuid 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:32:44.542129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1389c19c-e4c6-4357-9fa9-26a5f0726c08 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments/5a40ba7a-b8e4-429e-81af-1b5a8332d8f7" status: 202 len: 0 microversion: 2.1 time: 0.353800 Jun 21 18:32:44.542765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 337/676] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:32:44 2022] DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments/5a40ba7a-b8e4-429e-81af-1b5a8332d8f7 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:32:44.552527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:44.553699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:44.557155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=38 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:44.563327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.563823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.565006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.565511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.600774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2f24b0cf-b6cd-41b9-9744-b7348b904657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052926 Jun 21 18:32:44.601364 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 340/677] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:32:44 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:45.614680 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:45.615815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:45.623061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.623521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:45.624307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.624782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:45.673239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6b08109c-a8b4-4e15-b10c-8f7f822c2b18 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063156 Jun 21 18:32:45.673743 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 338/678] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:32:45 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:46.689613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:46.690534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:46.697637 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.698090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.698861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.699300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.728517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9ec75de7-1418-402e-bffa-76066dc9c654 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042834 Jun 21 18:32:46.729086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 341/679] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:32:46 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:32:46.811068 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:46.811735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:46.819182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.819629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.820463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.820928 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.849327 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:32:46.851480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:47.241251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bb870214-e024-4f73-872c-8b80b0960c40 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 204 len: 0 microversion: 2.1 time: 0.435009 Jun 21 18:32:47.241944 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 339/680] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:32:46 2022] DELETE /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:32:47.250664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:47.251270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:47.257795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.258241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.259626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.260059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.409185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:47.417961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-61d7e515-34c0-4648-8523-385ed399c657 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1688 microversion: 2.1 time: 0.171231 Jun 21 18:32:47.418682 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 342/681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:47 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:48.437168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:48.437863 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:48.444487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.444939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.446867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.446867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.587004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:48.595829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-50501914-3354-48fc-87e5-f6a5da974e73 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1688 microversion: 2.1 time: 0.163095 Jun 21 18:32:48.596524 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 340/682] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:48 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:49.614477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:49.615049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:49.622561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.622992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.623771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.626137 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.627387 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=82 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:49.761609 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:49.769063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3c026bea-4da1-41f8-a99b-a80f57287ea1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1688 microversion: 2.1 time: 0.158924 Jun 21 18:32:49.769698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 343/683] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:49 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:50.787126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:50.787757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:50.790542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:50.795352 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.795799 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.796650 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.797078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.938938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:50.949493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2044ac69-c7fc-4151-9f60-a06a46f3f6ba tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1688 microversion: 2.1 time: 0.166187 Jun 21 18:32:50.950097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 341/684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:50 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:51.213764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:51.214379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:51.221112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.221733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.222678 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.223263 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.255836 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6d49d4ef-410c-4798-955f-9e15bbefd715 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/ips" status: 200 len: 150 microversion: 2.1 time: 0.116732 Jun 21 18:32:51.256997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 344/685] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:32:51 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/ips => generated 150 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:51.967156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:51.967782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:51.974276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.974717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.975477 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.975903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.122624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:52.130315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-263ca3a1-30f6-4616-9946-f202ded8cf49 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1688 microversion: 2.1 time: 0.167071 Jun 21 18:32:52.130884 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 342/686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:51 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:52.631310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-07b008e1-28c1-40d8-a7d4-ce5fda3511fc req-3ac0250d-5f81-44ff-8d60-1a00ddc8e836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e", "name": "network-vif-deleted", "tag": "81daddb8-1b7a-4ac6-9809-b08697f621e7"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:52.645792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-07b008e1-28c1-40d8-a7d4-ce5fda3511fc req-3ac0250d-5f81-44ff-8d60-1a00ddc8e836 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:52.646379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-07b008e1-28c1-40d8-a7d4-ce5fda3511fc req-3ac0250d-5f81-44ff-8d60-1a00ddc8e836 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.662790 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-07b008e1-28c1-40d8-a7d4-ce5fda3511fc req-3ac0250d-5f81-44ff-8d60-1a00ddc8e836 service nova] Creating event network-vif-deleted:81daddb8-1b7a-4ac6-9809-b08697f621e7 for instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e on hv-cinder-83124 Jun 21 18:32:52.681975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-07b008e1-28c1-40d8-a7d4-ce5fda3511fc req-3ac0250d-5f81-44ff-8d60-1a00ddc8e836 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113423 Jun 21 18:32:52.682399 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 345/687] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:53.150221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:53.150874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:53.157717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.158164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.158934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.159363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.192774 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.193216 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.193657 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'fault' on Instance uuid 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:32:53.237856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:53.246133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5d7df3e9-d93b-4b64-9331-e736c6991c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 200 len: 1335 microversion: 2.1 time: 0.100590 Jun 21 18:32:53.246719 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 343/688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:53 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:53.363760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c222ebd-fd83-4fab-9d6c-bf55dd1cae15"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:53.364941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:53.380912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.380912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.380912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.380912 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.169916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bf770a58-050f-4a98-a210-fe2baecbe745 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806377 Jun 21 18:32:54.169916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 346/689] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:32:53 2022] POST /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:54.263667 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:54.264299 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:54.271423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.271875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.272701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.278703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.296198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] HTTP exception thrown: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Request method failure captured: Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e HTTP/1.1 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2HublXDJAIGwn0eNOGwP1YcsFgcFZEKXYyC2wd2NgCaRgL9K5yqzOiUDINHuJeDP_GebOwDuGO3yydvRBwCIsj9DyjTGZt6loXQhr_81XvbIJ34MHdvvPwEHXNLUzv1FrMZiBQc-5mPGxS_7wLGXXfVghHMVu2SFgtPiZve3-htV4 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:32:54.299577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 59f011e91b684e1288dad5f0ac733c0f Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. Jun 21 18:32:54.301450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e'} Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:32:54.302716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. Jun 21 18:32:54.308716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:32:54.310236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Returning 404 to user: Instance 2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:32:54.310236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-35c48e94-7075-4632-af9e-88e26b6e8f07 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e" status: 404 len: 111 microversion: 2.1 time: 0.042200 Jun 21 18:32:54.310236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 344/690] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:54 2022] GET /compute/v2.1/servers/2c83d189-dcca-4a89-b90e-f7ef7f2c1e8e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:32:54.314329 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3b581b72-8a15-4c6e-b8d4-e1eebd554c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '.version_select at 0x7fd39c07e5e0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:54.396354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3b581b72-8a15-4c6e-b8d4-e1eebd554c3d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559631262" status: 202 len: 0 microversion: 2.1 time: 0.087044 Jun 21 18:32:54.396959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 347/691] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559631262 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:32:57.802437 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:57.803006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:57.810123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:57.811462 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:57.812256 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:57.812724 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:57.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:32:58.193057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3bf682b3-7357-45c3-8af9-d5131e8c3e7b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 204 len: 0 microversion: 2.1 time: 0.394627 Jun 21 18:32:58.193647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 345/692] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:32:57 2022] DELETE /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:32:58.209907 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:58.210826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:58.218117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.218575 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.219394 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.219835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.358250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:58.365925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-65401076-b8ab-4470-896e-99e313ae7283 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1509 microversion: 2.1 time: 0.160571 Jun 21 18:32:58.366481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 348/693] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:58 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:59.384617 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:59.386290 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:59.394526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.394982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.395786 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.396223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.562486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:59.572009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a9bddbd2-b8c5-4f1c-8307-efed35e05484 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1509 microversion: 2.1 time: 0.191893 Jun 21 18:32:59.572890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 346/694] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:59 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:00.596819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:00.596819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:00.604906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.604906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.604906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.605614 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.705497 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-f077337f-40aa-48e3-86ab-1555ae2fac48 req-aa0fca3c-e964-480d-b433-90f4761bbeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128ab49-7ea8-40c8-a008-69a7ceac7769", "name": "network-vif-deleted", "tag": "9ebf45b0-5fbf-431b-85c1-01218c94add8"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:00.714380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-f077337f-40aa-48e3-86ab-1555ae2fac48 req-aa0fca3c-e964-480d-b433-90f4761bbeac service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.714814 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-f077337f-40aa-48e3-86ab-1555ae2fac48 req-aa0fca3c-e964-480d-b433-90f4761bbeac service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.718859 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:00.731754 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fed46756-1f75-4bc0-a914-3d30fd3cab71 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1467 microversion: 2.1 time: 0.144212 Jun 21 18:33:00.732574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 349/695] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:00 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1467 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:00.735232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-f077337f-40aa-48e3-86ab-1555ae2fac48 req-aa0fca3c-e964-480d-b433-90f4761bbeac service nova] Creating event network-vif-deleted:9ebf45b0-5fbf-431b-85c1-01218c94add8 for instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 on hv-cinder-83124 Jun 21 18:33:00.745059 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-f077337f-40aa-48e3-86ab-1555ae2fac48 req-aa0fca3c-e964-480d-b433-90f4761bbeac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042825 Jun 21 18:33:00.745733 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 347/696] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:01.715228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c222ebd-fd83-4fab-9d6c-bf55dd1cae15"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:01.720695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:01.723771 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.724226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.725052 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.725485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.750406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:01.751240 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:01.758231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.758866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.759999 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.761026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.798380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.798832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.799342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lazy-loading 'fault' on Instance uuid 7128ab49-7ea8-40c8-a008-69a7ceac7769 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:01.816282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: POST /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments HTTP/1.1 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 74 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:01.818063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {"volumeAttachment": {"volumeId": "5c222ebd-fd83-4fab-9d6c-bf55dd1cae15"}} Jun 21 18:33:01.819673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'server_id': '5ea73404-9343-4057-868c-7ee3c41c736d', 'body': {'volumeAttachment': {'volumeId': '5c222ebd-fd83-4fab-9d6c-bf55dd1cae15'}}} Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:01.820570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:01.821720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 400 to user: Invalid volume: volume 5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 is already attached to instances: 5ea73404-9343-4057-868c-7ee3c41c736d {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-464fcb53-84a8-4f03-a26a-287de221883b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109605 Jun 21 18:33:01.823013 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 350/697] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:33:01 2022] POST /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:33:01.842995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:01.851492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7fbe1f43-09ec-4826-85e3-0ce8ab3e3e2b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 200 len: 1312 microversion: 2.1 time: 0.105969 Jun 21 18:33:01.860717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 348/698] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:01 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:01.890343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:01.890837 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:01.897861 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.898306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.899166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.899600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.994429 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'services' on Instance uuid 5ea73404-9343-4057-868c-7ee3c41c736d {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:02.280576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ef2bb16b-90ac-455d-a7f4-752b5972b928 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments/5c222ebd-fd83-4fab-9d6c-bf55dd1cae15" status: 202 len: 0 microversion: 2.1 time: 0.393583 Jun 21 18:33:02.334819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 351/699] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:33:01 2022] DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments/5c222ebd-fd83-4fab-9d6c-bf55dd1cae15 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:33:02.334985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:02.334985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:02.334985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.334985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.335435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.335435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.353917 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-74897c83-1837-4989-876d-a669f215a5da tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055115 Jun 21 18:33:02.354618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 349/700] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:02 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:02.870346 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:02.871048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7128ab49-7ea8-40c8-a008-69a7ceac7769] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:02.878538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.878997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.879784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.880219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.894927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] HTTP exception thrown: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Request method failure captured: Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 HTTP/1.1 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2HublXDJAIGwn0eNOGwP1YcsFgcFZEKXYyC2wd2NgCaRgL9K5yqzOiUDINHuJeDP_GebOwDuGO3yydvRBwCIsj9DyjTGZt6loXQhr_81XvbIJ34MHdvvPwEHXNLUzv1FrMZiBQc-5mPGxS_7wLGXXfVghHMVu2SFgtPiZve3-htV4 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:02.896764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 59f011e91b684e1288dad5f0ac733c0f Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. Jun 21 18:33:02.898432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '7128ab49-7ea8-40c8-a008-69a7ceac7769'} Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:02.899275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. Jun 21 18:33:02.901128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:02.902400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Returning 404 to user: Instance 7128ab49-7ea8-40c8-a008-69a7ceac7769 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:02.902400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ce4bf339-fb7b-4f98-909a-fae33494b9f1 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769" status: 404 len: 111 microversion: 2.1 time: 0.032212 Jun 21 18:33:02.902400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 352/701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:02 2022] GET /compute/v2.1/servers/7128ab49-7ea8-40c8-a008-69a7ceac7769 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:02.907411 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:02.907936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:02.914609 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.915061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.916563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.917010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.942385 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:33:03.301331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1b031c81-5eef-42f3-852d-1d2225631c38 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 204 len: 0 microversion: 2.1 time: 0.397430 Jun 21 18:33:03.302259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 350/702] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:33:02 2022] DELETE /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:33:03.319296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:03.320413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:03.328828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.329433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.330275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.330680 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.366421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:03.367540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:03.375377 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.375822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.376626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.377053 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.413577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4e3d4c76-0db6-4dd1-9b4a-2ccc58ba6d4b tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Jun 21 18:33:03.414442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 351/703] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:03 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:03.487498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:03.497110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0fdec1a6-ab68-4931-860e-f9c7aa3f204b tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.184596 Jun 21 18:33:03.497692 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 353/704] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:03 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:04.424670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:04.425634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:04.432574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:04.433033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:04.433807 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:04.434248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:04.437025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:04.468422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c97f7ecd-a68a-4024-b5cf-1b4d5be0a639 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046901 Jun 21 18:33:04.469041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 352/705] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:04 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:04.515849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:04.516555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:04.523236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:04.523710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:04.524548 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:04.525059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:04.670363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:04.679476 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3241aa1b-6b24-42fa-9658-b88666301df2 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.167412 Jun 21 18:33:04.680166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 354/706] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:04 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:05.481101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:05.482038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:05.488938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.489392 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.490156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.490587 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.521038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e72d4bcf-c859-4dbe-8575-98996096fd84 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044380 Jun 21 18:33:05.521612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 353/707] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:05 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:33:05.581234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:05.581774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:05.588207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.588689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.589462 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.589904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.614751 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:33:05.696535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:05.697826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:05.704485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.704938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.705717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.706153 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.856837 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:05.868463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c9b05171-d467-489b-81cd-f291b109ede9 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.175505 Jun 21 18:33:05.869689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 354/708] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:05 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:05.960966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-27b29898-b7c4-4da1-a41e-ddcff11700df tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 204 len: 0 microversion: 2.1 time: 0.383149 Jun 21 18:33:05.961577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 355/709] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:33:05 2022] DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:05.971160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:05.971798 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:05.977992 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.978633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.979456 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.979895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:06.119008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:06.126840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ed1532ae-53d8-4e52-ac22-be102a402114 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1682 microversion: 2.1 time: 0.159642 Jun 21 18:33:06.127679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 355/710] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:05 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:06.891146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:06.891873 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:06.898676 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:06.899121 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:06.899899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:06.900377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:07.062119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:07.070251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-eb3254d4-eb62-4d7e-84d1-19232853425d tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1522 microversion: 2.1 time: 0.183225 Jun 21 18:33:07.070854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 356/711] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:06 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:07.145402 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:07.145997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:07.153668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:07.154110 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:07.154876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:07.155307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:07.298303 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:07.306965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-941a828d-061e-49e4-8729-fe4abf18dde9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1682 microversion: 2.1 time: 0.164997 Jun 21 18:33:07.307593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 356/712] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:07 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:08.041395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-23b0135e-e989-4a28-99c1-51744f91cf76 req-12050db4-fa3d-44c0-bb95-eabab1a27b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b830661-c720-48f3-95c1-803626d60a9d", "name": "network-vif-deleted", "tag": "2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:08.055862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-23b0135e-e989-4a28-99c1-51744f91cf76 req-12050db4-fa3d-44c0-bb95-eabab1a27b21 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.057020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-23b0135e-e989-4a28-99c1-51744f91cf76 req-12050db4-fa3d-44c0-bb95-eabab1a27b21 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.070029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-23b0135e-e989-4a28-99c1-51744f91cf76 req-12050db4-fa3d-44c0-bb95-eabab1a27b21 service nova] Creating event network-vif-deleted:2cd8582e-3e8b-4b42-8ffd-a2265c79e9a0 for instance 7b830661-c720-48f3-95c1-803626d60a9d on hv-cinder-83124 Jun 21 18:33:08.076745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-23b0135e-e989-4a28-99c1-51744f91cf76 req-12050db4-fa3d-44c0-bb95-eabab1a27b21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046983 Jun 21 18:33:08.078721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 357/713] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:08.089333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:08.097010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:08.097010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.097561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.098379 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.098814 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.206831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f011e91b684e1288dad5f0ac733c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aedc59673c405096de01eaf61ecd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:08.216655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9b7d87f3-3178-49f1-943e-962d0c8275b6 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 200 len: 1480 microversion: 2.1 time: 0.131903 Jun 21 18:33:08.226784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:08 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 1480 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:08.326348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:08.327044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:08.334461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.334918 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.335726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.336165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.524737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:08.538327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7fde1979-dacf-4c42-b3a5-95ec64dc312f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1682 microversion: 2.1 time: 0.216877 Jun 21 18:33:08.539435 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 358/715] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:08 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:09.211996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-07b32d26-d907-4915-a7f3-1947767300cb req-c193bcf9-ea81-4513-a447-a1d82c243e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea73404-9343-4057-868c-7ee3c41c736d", "name": "network-vif-deleted", "tag": "a5b5eaff-fa4c-463e-ba6c-1c8709124a94"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:09.236131 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-07b32d26-d907-4915-a7f3-1947767300cb req-c193bcf9-ea81-4513-a447-a1d82c243e79 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.237207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:09.237207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] [instance: 7b830661-c720-48f3-95c1-803626d60a9d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:09.239271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-07b32d26-d907-4915-a7f3-1947767300cb req-c193bcf9-ea81-4513-a447-a1d82c243e79 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.256823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.257300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.258333 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.258774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.276603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-07b32d26-d907-4915-a7f3-1947767300cb req-c193bcf9-ea81-4513-a447-a1d82c243e79 service nova] Creating event network-vif-deleted:a5b5eaff-fa4c-463e-ba6c-1c8709124a94 for instance 5ea73404-9343-4057-868c-7ee3c41c736d on hv-cinder-83124 Jun 21 18:33:09.282660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-07b32d26-d907-4915-a7f3-1947767300cb req-c193bcf9-ea81-4513-a447-a1d82c243e79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168543 Jun 21 18:33:09.283631 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 358/716] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:09.289573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] HTTP exception thrown: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Request method failure captured: Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d HTTP/1.1 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2HublXDJAIGwn0eNOGwP1YcsFgcFZEKXYyC2wd2NgCaRgL9K5yqzOiUDINHuJeDP_GebOwDuGO3yydvRBwCIsj9DyjTGZt6loXQhr_81XvbIJ34MHdvvPwEHXNLUzv1FrMZiBQc-5mPGxS_7wLGXXfVghHMVu2SFgtPiZve3-htV4 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:09.292116 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10aedc59673c405096de01eaf61ecd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 10aedc59673c405096de01eaf61ecd6f Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1786084797 Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 59f011e91b684e1288dad5f0ac733c0f Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1786084797-project Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. Jun 21 18:33:09.298497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '7b830661-c720-48f3-95c1-803626d60a9d'} Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:09.299379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. Jun 21 18:33:09.301079 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:09.302464 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] Returning 404 to user: Instance 7b830661-c720-48f3-95c1-803626d60a9d could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:09.302464 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3cbcd78b-3034-4699-af1a-2ccabcc76427 tempest-ServerRescueNegativeTestJSON-1786084797 tempest-ServerRescueNegativeTestJSON-1786084797-project] 10.222.0.23 "GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d" status: 404 len: 111 microversion: 2.1 time: 0.062205 Jun 21 18:33:09.302464 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 359/717] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:09 2022] GET /compute/v2.1/servers/7b830661-c720-48f3-95c1-803626d60a9d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:33:09.558727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:09.559817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:09.567888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.569223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.570879 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.571424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.616686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:09.617500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.618207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'fault' on Instance uuid 5ea73404-9343-4057-868c-7ee3c41c736d {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:09.696217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:09.707621 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fa9856d6-6f9f-43f9-9393-95975f297de9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 200 len: 1331 microversion: 2.1 time: 0.155314 Jun 21 18:33:09.711476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 359/718] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:09 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:10.727331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:10.727946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:10.736827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.737204 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.738024 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.738466 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.741547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:10.753159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:10.755142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:10.755255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d HTTP/1.1 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:10.757328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:33:10.758913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '5ea73404-9343-4057-868c-7ee3c41c736d'} Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:10.760446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:33:10.761980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:10.763358 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:10.763358 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8b77db7a-2011-4f7c-96f1-741b104f4130 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 404 len: 111 microversion: 2.1 time: 0.035503 Jun 21 18:33:10.763624 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 360/719] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:10 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:10.764024 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.764715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.765721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.766333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.768571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bd4639fc-802d-485f-b393-ca61e32c00a6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '.version_select at 0x7fd39c0dae50>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:10.793233 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6aadab96-1e92-4760-9fe0-82c3ece0a12a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/ips" status: 200 len: 152 microversion: 2.20 time: 0.044172 Jun 21 18:33:10.795354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 360/720] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Jun 21 18:33:10 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:33:10.896696 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bd4639fc-802d-485f-b393-ca61e32c00a6 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788078337" status: 202 len: 0 microversion: 2.1 time: 0.131799 Jun 21 18:33:10.897309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 361/721] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788078337 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:33:12.050345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2a17b370-1d02-46fd-83fd-bd60c1b8d2fd tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: .version_select at 0x7fd396e87f70>, body: {"keypair": {"name": "tempest-keypair-226360494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnLOleERDoqzXGtyKHg3mL4PgM61zBOSzoS3FNEwMVQvQg7D/P7nXTN85OBaVBCHPzwd/NqQ99TGn6svhC41uc5j1F/g/aN7F0dUvC+07RbHl72r+WiqorInbkM/EkMg=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:12.069244 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-2a17b370-1d02-46fd-83fd-bd60c1b8d2fd tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:33:12.078346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-2a17b370-1d02-46fd-83fd-bd60c1b8d2fd tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:33:12.225305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2a17b370-1d02-46fd-83fd-bd60c1b8d2fd tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179653 Jun 21 18:33:12.226042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 361/722] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:33:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:13.143162 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:13.145357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:13.158112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:13.158112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:13.158112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:13.158681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:13.195705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lazy-loading 'flavor' on Instance uuid 4691899e-d090-41b8-928f-a73ce8a05719 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:13.926075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b375f73c-e12e-4d7f-8cd8-f235d39f5dfd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/action" status: 202 len: 0 microversion: 2.20 time: 0.795367 Jun 21 18:33:13.928070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 362/723] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jun 21 18:33:13 2022] POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:13.943206 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:13.943952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:13.968756 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:13.969795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:13.971602 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:13.972521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:14.300582 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:14.313525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:14.316057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:14.316810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6f91d89e-1908-4cc8-a0ee-0caf1ff4fa39 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.383264 Jun 21 18:33:14.317594 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 362/724] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:13 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:14.748882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1571813508"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:14.750283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:14.758007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:14.758465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:14.759884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:14.760599 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:14.977647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.network.security_group_api [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Removing security group a4a1ee2f-2ddc-40d0-a513-fb6211218c91 from port 839a5a4d-fb74-4118-bb14-b344123ac80c Jun 21 18:33:15.351677 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:15.355885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:15.367763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:15.369127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:15.370639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:15.371433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:15.657218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5fee85a6-a154-4722-bd12-d8742296e391 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action" status: 202 len: 0 microversion: 2.1 time: 0.913463 Jun 21 18:33:15.658663 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 363/725] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:33:14 2022] POST /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:33:15.684543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-757d7985-e042-4152-9a1e-a213cf46857d req-77d76489-4209-4927-a2d0-7b1c3f2fe8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:15.714444 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-757d7985-e042-4152-9a1e-a213cf46857d req-77d76489-4209-4927-a2d0-7b1c3f2fe8d0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:15.727176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-757d7985-e042-4152-9a1e-a213cf46857d req-77d76489-4209-4927-a2d0-7b1c3f2fe8d0 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:15.750003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:15.777589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-757d7985-e042-4152-9a1e-a213cf46857d req-77d76489-4209-4927-a2d0-7b1c3f2fe8d0 service nova] Creating event network-changed:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:33:15.785097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:15.794465 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:15.796720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-757d7985-e042-4152-9a1e-a213cf46857d req-77d76489-4209-4927-a2d0-7b1c3f2fe8d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125662 Jun 21 18:33:15.798659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-01417447-fce1-48ec-871c-a93776c97450 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.454269 Jun 21 18:33:15.799923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 363/726] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:15 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:15.800555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 364/727] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:16.081809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-714056059", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89bb927a-5407-4745-a764-78e1bdbbf5fe"}], "security_groups": [{"name": "tempest-securitygroup--877573054"}], "key_name": "tempest-keypair-226360494", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:16.371531 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] validate_networks() for [('89bb927a-5407-4745-a764-78e1bdbbf5fe', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:33:16.840545 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:16.847197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:16.855483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:16.873719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:16.874360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:16.876504 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:16.877906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.321171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:17.339092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:17.342904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:17.345341 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-55def1d5-f778-4a0e-a565-9cc7ce6ce2ee tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.513700 Jun 21 18:33:17.353365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 365/728] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:16 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:17.673589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:33:17.674154 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:33:17.674464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:33:17.674873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:33:17.675281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:33:17.685801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.686254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.687058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.687556 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.708881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:33:17.730106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Getting quotas for user 5c21b9f596da493fac827d3573833ed1 and project 48dc636c17544593aaf2a2409c13e540. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:33:17.767595 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:33:17.769330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:33:17.773310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:17.773822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:17.781283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.781943 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.782764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.783796 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.917135 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lazy-loading 'services' on Instance uuid e5e88bfd-a539-44f7-9acb-3aafcd6324b2 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:17.972242 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1fc6ead9-6838-49f2-a0aa-987fa566e3a9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.894969 Jun 21 18:33:17.978083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 364/729] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:33:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:33:17.984219 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-40ff852f-390f-431a-b64d-716294501726 req-77863585-3bf8-49ea-a8cb-e84bf79e3c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:17.995572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-40ff852f-390f-431a-b64d-716294501726 req-77863585-3bf8-49ea-a8cb-e84bf79e3c07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.996202 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-40ff852f-390f-431a-b64d-716294501726 req-77863585-3bf8-49ea-a8cb-e84bf79e3c07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.013238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-40ff852f-390f-431a-b64d-716294501726 req-77863585-3bf8-49ea-a8cb-e84bf79e3c07 service nova] Creating event network-changed:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:33:18.015569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-40ff852f-390f-431a-b64d-716294501726 req-77863585-3bf8-49ea-a8cb-e84bf79e3c07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040030 Jun 21 18:33:18.016505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 365/730] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:18.159931 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-22bb28ed-de8e-463c-9b47-3c806cd6ccc4 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments/2a479647-65ad-4c78-b98f-b67f280f5130" status: 202 len: 0 microversion: 2.1 time: 0.390530 Jun 21 18:33:18.165882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 366/731] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:33:17 2022] DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments/2a479647-65ad-4c78-b98f-b67f280f5130 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:33:18.172922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c0d1af81-c3a0-4d74-81f4-7fd9ceab17f9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.179195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c0d1af81-c3a0-4d74-81f4-7fd9ceab17f9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:18.247513 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c0d1af81-c3a0-4d74-81f4-7fd9ceab17f9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:18.257443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c0d1af81-c3a0-4d74-81f4-7fd9ceab17f9 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1240 microversion: 2.1 time: 0.088979 Jun 21 18:33:18.258056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 367/732] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:18 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:18.265411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.267501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:18.275893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:18.276757 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.278199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:18.278664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.300549 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32c7b703-f245-4118-bc65-0fad3133c091 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Action: 'create', calling method: .version_select at 0x7fd396f3d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1751435188", "metadata": {"Type": "work"}}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:18.324097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ae9dd42a-dc7c-4a5e-a79e-22c5c91c6b5d tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064708 Jun 21 18:33:18.325443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 368/733] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:18 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32c7b703-f245-4118-bc65-0fad3133c091 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 122 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:33:18.340163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1751435188", "metadata": {"Type": "work"}}} Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: Jun 21 18:33:18.341989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1751435188', 'metadata': {'Type': 'work'}}}} Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.343014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:33:18.344642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:33:18.346122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:33:18.346122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.346122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32c7b703-f245-4118-bc65-0fad3133c091 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.346122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-32c7b703-f245-4118-bc65-0fad3133c091 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.324966 Jun 21 18:33:18.346122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 366/734] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jun 21 18:33:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:33:18.355269 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c92446d3-0478-43fd-993e-0e4b8850ce4e tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Action: 'create', calling method: .version_select at 0x7fd39c179dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1840330883", "metadata": {"Type": "work"}}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c92446d3-0478-43fd-993e-0e4b8850ce4e tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 120 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:18.359649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1840330883", "metadata": {"Type": "work"}}} Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:33:18.361507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1840330883', 'metadata': {'Type': 'work'}}}} Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi '0' Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.362666 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:33:18.364469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:33:18.366051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:33:18.366051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.369571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c92446d3-0478-43fd-993e-0e4b8850ce4e tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.371276 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c92446d3-0478-43fd-993e-0e4b8850ce4e tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020211 Jun 21 18:33:18.375938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 369/735] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jun 21 18:33:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:33:18.384957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.386609 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:18.391337 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6ada68fd-6db4-4ced-9507-271f33ad77e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Action: 'create', calling method: .version_select at 0x7fd3977c83a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-341871911", "metadata": {"Type": "work"}}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6ada68fd-6db4-4ced-9507-271f33ad77e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 118 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:18.394373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-341871911", "metadata": {"Type": "work"}}} Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:33:18.396088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-341871911', 'metadata': {'Type': 'work'}}}} Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi '' Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.396970 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:33:18.398571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:33:18.409225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:33:18.409225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.409225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6ada68fd-6db4-4ced-9507-271f33ad77e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.409225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6ada68fd-6db4-4ced-9507-271f33ad77e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021646 Jun 21 18:33:18.409225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 370/736] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jun 21 18:33:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:33:18.410241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:18.411078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.412695 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:18.413503 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.428561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8044a19b-7abc-4311-8258-e2a0f5ea6d9d tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Calling method '.version_select at 0x7fd39c1cc670>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.467139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-8044a19b-7abc-4311-8258-e2a0f5ea6d9d tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] HTTP exception thrown: Volume tempest-invalid-1547175505 could not be found. Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8044a19b-7abc-4311-8258-e2a0f5ea6d9d tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1547175505 HTTP/1.1 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:18.469168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Volume tempest-invalid-1547175505 could not be found. Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'tempest-invalid-1547175505'} Jun 21 18:33:18.470706 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1547175505 could not be found. (HTTP 404) (Request-ID: req-7f57d904-8e38-47d2-9e35-9f1dcd54f0ec) Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.471527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:33:18.473005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1547175505 could not be found. Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:18.474152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1547175505 could not be found. Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1547175505 could not be found. Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8044a19b-7abc-4311-8258-e2a0f5ea6d9d tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 404 to user: Volume tempest-invalid-1547175505 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.476382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8044a19b-7abc-4311-8258-e2a0f5ea6d9d tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1547175505" status: 404 len: 99 microversion: 2.1 time: 0.056514 Jun 21 18:33:18.478442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 371/737] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:33:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1547175505 => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 18:33:18.483553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0400ed36-48e6-4eba-861c-2c5e9e5a0f57 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004095 Jun 21 18:33:18.490081 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 372/738] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Jun 21 18:33:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 18:33:18.502617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e496646f-08ad-4371-ac83-07fa1242e7e2 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009348 Jun 21 18:33:18.503252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 373/739] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Jun 21 18:33:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 18:33:18.515482 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2710d00c-02aa-4ec0-8a04-0aafd13b8e69 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Calling method '.version_select at 0x7fd39c0da820>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.548443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-2710d00c-02aa-4ec0-8a04-0aafd13b8e69 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] HTTP exception thrown: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2710d00c-02aa-4ec0-8a04-0aafd13b8e69 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/os-volumes/daeb2e0e-e3ee-406a-b684-ff985a676bdb HTTP/1.1 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:18.550978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'daeb2e0e-e3ee-406a-b684-ff985a676bdb'} Jun 21 18:33:18.552746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. (HTTP 404) (Request-ID: req-5e977c41-c760-4ffc-b901-ed0989c50f39) Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.560703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:33:18.561851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:33:18.562995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2710d00c-02aa-4ec0-8a04-0aafd13b8e69 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 404 to user: Volume daeb2e0e-e3ee-406a-b684-ff985a676bdb could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2710d00c-02aa-4ec0-8a04-0aafd13b8e69 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/daeb2e0e-e3ee-406a-b684-ff985a676bdb" status: 404 len: 109 microversion: 2.1 time: 0.041123 Jun 21 18:33:18.564127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 374/740] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:33:18 2022] DELETE /compute/v2.1/os-volumes/daeb2e0e-e3ee-406a-b684-ff985a676bdb => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:33:18.565857 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c8e467f8-c35b-496e-9dc3-66d47e6f61e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Calling method '.version_select at 0x7fd3977c85e0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:18.598709 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-c8e467f8-c35b-496e-9dc3-66d47e6f61e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] HTTP exception thrown: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c8e467f8-c35b-496e-9dc3-66d47e6f61e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Request method failure captured: Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/os-volumes/0cbf43e8-4de2-4adf-a180-d112c54407c6 HTTP/1.1 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg7tNAOUik83lS75uSBWHY36C8dcf282TjdJg_KJoGQkKjmIZKFq6Y1deWUADBi1a5fSjHoVZpkqY9rgqFTNr9K1QrlKCSlfAAckcyOvgAn00eTPHijq2xun-P_CvrEOdhAiecxQqnADwquPv835C8xKcvT1CLDkHJZc72-ZRjRRSSw Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:18.600769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa622e06228e4136921d18ef9dacd5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: fa622e06228e4136921d18ef9dacd5a1 Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesNegativeTest-535823923 Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 7a5dc3889cfc4418bf8447b7088f0572 Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesNegativeTest-535823923-project Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '0cbf43e8-4de2-4adf-a180-d112c54407c6'} Jun 21 18:33:18.602158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. (HTTP 404) (Request-ID: req-f30a6cd7-f5cc-4715-9de3-e7b44fb3b201) Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.610044 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:33:18.611265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:33:18.612488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c8e467f8-c35b-496e-9dc3-66d47e6f61e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] Returning 404 to user: Volume 0cbf43e8-4de2-4adf-a180-d112c54407c6 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c8e467f8-c35b-496e-9dc3-66d47e6f61e5 tempest-VolumesNegativeTest-535823923 tempest-VolumesNegativeTest-535823923-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0cbf43e8-4de2-4adf-a180-d112c54407c6" status: 404 len: 109 microversion: 2.1 time: 0.041112 Jun 21 18:33:18.613766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 375/741] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:33:18 2022] GET /compute/v2.1/os-volumes/0cbf43e8-4de2-4adf-a180-d112c54407c6 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:33:18.715415 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:18.742629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:18.747441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:18.752892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-94d0cdbc-1808-4a54-8b2d-5340d1abe330 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.380955 Jun 21 18:33:18.754666 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 367/742] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:18 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:19.288821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e75d1fca-902c-4dfd-9b0e-b8cc3b3f0ac3 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:19.289601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e75d1fca-902c-4dfd-9b0e-b8cc3b3f0ac3 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:19.339134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:19.340331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:19.348439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.348990 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.349878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.350410 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.360242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e75d1fca-902c-4dfd-9b0e-b8cc3b3f0ac3 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:19.370631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e75d1fca-902c-4dfd-9b0e-b8cc3b3f0ac3 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1240 microversion: 2.1 time: 0.085749 Jun 21 18:33:19.371481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 376/743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:19 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:19.407270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-82bbfbf0-6b23-4c50-8f78-e5fc617f7672 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073310 Jun 21 18:33:19.408887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 368/744] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:33:19 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:33:19.420980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:19.426665 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:19.435862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.435862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.435862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.435862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.542030 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] HTTP exception thrown: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 is not attached to volume 2a479647-65ad-4c78-b98f-b67f280f5130 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Request method failure captured: Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments/2a479647-65ad-4c78-b98f-b67f280f5130 HTTP/1.1 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg5S4S5NiLMolU9QJdAIrovY4LavawBg4cEVomlty6SxcZHOsvbL8tEt-5AgzMxS2ViWSWToLZG7GMFk-1qoyz-8WS2m9tDOyIPSEB4Kdut_cfMu7uIaZ8V7A22TatY72LEaRBDRXzmTqCm9SpkY9s7Q0htPnPcHetTQBWW9vi3R_H8 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 1a1786032e9449728e36f679515ced6d Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:19.549231 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a1786032e9449728e36f679515ced6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a1786032e9449728e36f679515ced6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a1786032e9449728e36f679515ced6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a1786032e9449728e36f679515ced6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 1a1786032e9449728e36f679515ced6d Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-TestMinimumBasicScenario-1667380701-project Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 0e634ab2f0944e24a087a10e36451f08 Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-TestMinimumBasicScenario-1667380701-project Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:19.552824 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 is not attached to volume 2a479647-65ad-4c78-b98f-b67f280f5130 Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'server_id': 'e5e88bfd-a539-44f7-9acb-3aafcd6324b2', 'id': '2a479647-65ad-4c78-b98f-b67f280f5130'} Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2a479647-65ad-4c78-b98f-b67f280f5130. Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:19.553748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 is not attached to volume 2a479647-65ad-4c78-b98f-b67f280f5130 Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 is not attached to volume 2a479647-65ad-4c78-b98f-b67f280f5130 Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:19.555168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Returning 404 to user: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 is not attached to volume 2a479647-65ad-4c78-b98f-b67f280f5130 {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:19.556669 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-13b731a2-4d01-4b30-a2bf-5e9153273ae3 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments/2a479647-65ad-4c78-b98f-b67f280f5130" status: 404 len: 154 microversion: 2.1 time: 0.136522 Jun 21 18:33:19.557800 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 377/745] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:33:19 2022] DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2/os-volume_attachments/2a479647-65ad-4c78-b98f-b67f280f5130 => generated 154 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:19.774363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:19.775386 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:19.782717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.783315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.784653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.785434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.050255 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:20.074354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:20.077704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:20.080661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-49fac11d-196d-475d-ae03-960cf3df2390 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.310780 Jun 21 18:33:20.081699 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 369/746] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:19 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:20.400820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:20.401856 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:20.411273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.411938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.413065 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.413611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.488008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:20.502913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f9aba751-1f86-4b32-9059-3297dab924f7 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1292 microversion: 2.1 time: 0.110629 Jun 21 18:33:20.507950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 378/747] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:20 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:20.913159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:20.914916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:20.924002 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:20.932106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.933067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.934799 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.935585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.024286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:33:21.105628 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:21.106489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:21.114802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.115274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.116199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.116765 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.289629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:21.304620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:21.310689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:21.314586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bc22fdab-88b1-4d1f-be2a-e48b334826f3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.214749 Jun 21 18:33:21.316893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 379/748] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:21 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:21.492313 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fe8b9885-4fca-4f7e-aa83-57adb9dc0066 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 204 len: 0 microversion: 2.1 time: 0.589457 Jun 21 18:33:21.493071 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 370/749] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:33:20 2022] DELETE /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:21.503869 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:21.504631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:21.511517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.511964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.513257 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.514488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.522731 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:21.523440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:21.544025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.544499 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.545527 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:21.545971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:21.550704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:21.678355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:21.694781 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3af2d2e3-bbfc-4bf9-9a91-3262dfaac52f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1298 microversion: 2.1 time: 0.175977 Jun 21 18:33:21.695755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 371/750] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:21 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:21.735438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:21.743965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5d2ce2de-22e9-4b6c-8c5d-4a4faf836c86 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1552 microversion: 2.1 time: 0.244653 Jun 21 18:33:21.744667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 380/751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:21 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:22.337913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:22.338761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:22.346204 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.346650 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.347450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.347894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.515417 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:22.529413 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:22.532370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:22.534993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-78523707-29ca-453a-9716-4bfc740ac07b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.202733 Jun 21 18:33:22.536062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 372/752] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:22 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:22.714354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:22.714904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:22.722041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.722498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.723285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.723734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.772260 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:22.772620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:22.781412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.781874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.782697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.783197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.922196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:22.931826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f616d81f-3d98-4ff3-a61f-d326f818066c tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.221535 Jun 21 18:33:22.932631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 381/753] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:22 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:23.021002 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:23.038654 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b26bfba-8394-49e9-9222-7e4b082650eb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1552 microversion: 2.1 time: 0.272521 Jun 21 18:33:23.039245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 373/754] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:22 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1552 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:23.557078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:23.564267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:23.577010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:23.577851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:23.578881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:23.579584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:23.792679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:23.805310 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:23.808149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:23.809330 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c68a024e-b828-480c-8405-47c6b2435a3e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.257609 Jun 21 18:33:23.810012 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 382/755] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:23 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:23.943009 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b4ffad4a-e14b-4973-83fd-0eafe72540a3 req-97c295b2-4ab6-458b-be71-7fba7636f13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e88bfd-a539-44f7-9acb-3aafcd6324b2", "name": "network-vif-deleted", "tag": "839a5a4d-fb74-4118-bb14-b344123ac80c"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:23.953829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b4ffad4a-e14b-4973-83fd-0eafe72540a3 req-97c295b2-4ab6-458b-be71-7fba7636f13e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:23.954599 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b4ffad4a-e14b-4973-83fd-0eafe72540a3 req-97c295b2-4ab6-458b-be71-7fba7636f13e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:23.963401 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:23.965011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:23.969188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-b4ffad4a-e14b-4973-83fd-0eafe72540a3 req-97c295b2-4ab6-458b-be71-7fba7636f13e service nova] Creating event network-vif-deleted:839a5a4d-fb74-4118-bb14-b344123ac80c for instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 on hv-cinder-83124 Jun 21 18:33:23.975072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b4ffad4a-e14b-4973-83fd-0eafe72540a3 req-97c295b2-4ab6-458b-be71-7fba7636f13e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035630 Jun 21 18:33:23.976022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 374/756] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:24.004661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.005907 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.007288 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.013181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.032866 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ebf54884-4611-4ed4-bea3-6d3a779acabe req-19e23f2d-966b-4679-baa0-39e850615166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c0bf4d-7121-4d96-a178-a61938b8dc31", "tag": "a67690e4-5041-4782-b992-443273622b1a"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:24.050358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ebf54884-4611-4ed4-bea3-6d3a779acabe req-19e23f2d-966b-4679-baa0-39e850615166 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.050806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ebf54884-4611-4ed4-bea3-6d3a779acabe req-19e23f2d-966b-4679-baa0-39e850615166 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.079182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ebf54884-4611-4ed4-bea3-6d3a779acabe req-19e23f2d-966b-4679-baa0-39e850615166 service nova] Creating event network-changed:a67690e4-5041-4782-b992-443273622b1a for instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 on hv-cinder-83124 Jun 21 18:33:24.085102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ebf54884-4611-4ed4-bea3-6d3a779acabe req-19e23f2d-966b-4679-baa0-39e850615166 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056465 Jun 21 18:33:24.086423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 375/757] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:24.098744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:24.099884 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:24.110152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.111171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.112325 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.113026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.224938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e634ab2f0944e24a087a10e36451f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1786032e9449728e36f679515ced6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:24.249328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7ec00fa6-55b2-40e9-878b-c41c734ad2d2 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 200 len: 1341 microversion: 2.1 time: 0.150178 Jun 21 18:33:24.249328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 376/758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:24 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 1341 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:24.295651 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:24.309472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5fb08fb4-ed4b-46d9-8794-2a2a7bf77ec8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.356432 Jun 21 18:33:24.324297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 383/759] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:23 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:24.839134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:24.840975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:24.847416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.848143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.848979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.849428 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.066684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:25.082981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:25.085939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:25.088673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7728429d-a418-4106-bf69-20968710ec2f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.253841 Jun 21 18:33:25.089710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 377/760] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:24 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:25.265788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:25.275316 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] [instance: e5e88bfd-a539-44f7-9acb-3aafcd6324b2] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:25.303361 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:25.308088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.308088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:25.308088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.330905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] HTTP exception thrown: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Request method failure captured: Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 HTTP/1.1 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg5S4S5NiLMolU9QJdAIrovY4LavawBg4cEVomlty6SxcZHOsvbL8tEt-5AgzMxS2ViWSWToLZG7GMFk-1qoyz-8WS2m9tDOyIPSEB4Kdut_cfMu7uIaZ8V7A22TatY72LEaRBDRXzmTqCm9SpkY9s7Q0htPnPcHetTQBWW9vi3R_H8 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 1a1786032e9449728e36f679515ced6d Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:33:25.333168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a1786032e9449728e36f679515ced6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a1786032e9449728e36f679515ced6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a1786032e9449728e36f679515ced6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a1786032e9449728e36f679515ced6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 1a1786032e9449728e36f679515ced6d Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1667380701 Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-TestMinimumBasicScenario-1667380701-project Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 0e634ab2f0944e24a087a10e36451f08 Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-TestMinimumBasicScenario-1667380701-project Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. Jun 21 18:33:25.334634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'e5e88bfd-a539-44f7-9acb-3aafcd6324b2'} Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:25.335438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. Jun 21 18:33:25.336670 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:33:25.338333 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Returning 404 to user: Instance e5e88bfd-a539-44f7-9acb-3aafcd6324b2 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:25.338333 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7df053b1-401e-491f-8d94-a9f210f974b9 tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2" status: 404 len: 111 microversion: 2.1 time: 0.075901 Jun 21 18:33:25.338626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:25.338626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:25.340556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 384/761] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:25 2022] GET /compute/v2.1/servers/e5e88bfd-a539-44f7-9acb-3aafcd6324b2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:25.344599 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:25.345051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.345822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:25.346253 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.348756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4de6fe87-071a-468d-a78f-5bd45a73cfeb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] Calling method '.version_select at 0x7fd3977c88b0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:25.436295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4de6fe87-071a-468d-a78f-5bd45a73cfeb tempest-TestMinimumBasicScenario-1667380701 tempest-TestMinimumBasicScenario-1667380701-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-346600082" status: 202 len: 0 microversion: 2.1 time: 0.093000 Jun 21 18:33:25.436905 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 385/762] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Jun 21 18:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-346600082 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:33:25.560435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:25.571935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-27a0bcc0-581e-4a8d-b750-4b57d9b0c658 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.240671 Jun 21 18:33:25.573008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 378/763] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:25 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:26.115774 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:26.116823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:26.126343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.126863 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.128343 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.129190 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.307981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:26.317291 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:26.318801 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:26.320115 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ed6310ab-7560-454e-ac23-81d7379a598c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.210764 Jun 21 18:33:26.320707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 386/764] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:26 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:26.591384 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:26.591986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:26.600070 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.600576 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.601406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.601845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.745511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:26.760794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f73d802f-3ae8-4850-b5e2-da8c5fecf067 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.172796 Jun 21 18:33:26.767307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 379/765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:26 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:27.340261 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:27.341017 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:27.348035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.348521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:27.349332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.349766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:27.389234 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:27.653715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:27.664210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:27.668378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:27.669884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c292c84f-48fc-4b25-a97c-4bdf4ba5e5ad tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.334489 Jun 21 18:33:27.670974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 387/766] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:27 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:27.796055 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:27.800934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:27.805643 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:27.808871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:27.816624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.817934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:27.819007 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.820675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:28.105115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:28.116380 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0dd0d485-6e19-4149-bc69-30509e1823ed tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.324298 Jun 21 18:33:28.117515 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 380/767] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:27 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:28.698370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:28.699158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:28.707070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:28.707636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:28.714969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:28.714969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:28.991737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:29.002020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:29.004141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:29.005660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-93e3ae1b-d8de-4b17-9069-1a4b4daac204 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.313169 Jun 21 18:33:29.006783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 388/768] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:28 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:29.135186 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:29.137063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:29.161052 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:29.162829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:29.167605 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:29.168996 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:29.367121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:29.375688 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-008d72a5-ac84-457d-af63-22c2e0ced9e8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.245124 Jun 21 18:33:29.376281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 381/769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:29 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:30.041671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:30.043931 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:30.065115 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:30.081230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.082210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.083839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.086033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.394782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:30.401280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:30.407218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:30.413506 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.413957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.414748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.415218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.423796 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:30.426180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:30.427649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9f81f638-eac3-4a1f-aa82-fbde9a3ce04d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1744 microversion: 2.20 time: 0.395086 Jun 21 18:33:30.428517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 389/770] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:30 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1744 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:30.673512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:30.689560 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0f43f2bc-1d25-4720-b1de-1b600e756311 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.297714 Jun 21 18:33:30.700847 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 382/771] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:30 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:30.904507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-2d79e1b2-d188-44d4-b455-4aa78e8edfd9 req-30fd8b9f-8d6c-48df-aee0-61f0f6c5ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c0bf4d-7121-4d96-a178-a61938b8dc31", "name": "network-vif-plugged", "status": "completed", "tag": "a67690e4-5041-4782-b992-443273622b1a"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:30.969888 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-2d79e1b2-d188-44d4-b455-4aa78e8edfd9 req-30fd8b9f-8d6c-48df-aee0-61f0f6c5ffee service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.970972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-2d79e1b2-d188-44d4-b455-4aa78e8edfd9 req-30fd8b9f-8d6c-48df-aee0-61f0f6c5ffee service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.007063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-2d79e1b2-d188-44d4-b455-4aa78e8edfd9 req-30fd8b9f-8d6c-48df-aee0-61f0f6c5ffee service nova] Creating event network-vif-plugged:a67690e4-5041-4782-b992-443273622b1a for instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 on hv-cinder-83124 Jun 21 18:33:31.013453 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-2d79e1b2-d188-44d4-b455-4aa78e8edfd9 req-30fd8b9f-8d6c-48df-aee0-61f0f6c5ffee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349885 Jun 21 18:33:31.014242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 390/772] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:31.452218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:31.453751 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:31.468332 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.471655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.473286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.474172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.708328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:31.709139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:31.722365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.722829 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.726672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.729843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.775783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:31.789955 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:31.796282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:31.797636 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-71ddb760-3d87-44c4-aaad-682bbdead53e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1744 microversion: 2.20 time: 0.351828 Jun 21 18:33:31.814383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 383/773] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:31 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1744 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:32.129988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:32.139791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ff4456f0-4cc2-4b3c-a14b-d5c15b57a768 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.437182 Jun 21 18:33:32.140757 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 391/774] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:31 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:32.833483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:32.834675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:32.843572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:32.844320 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:32.854788 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:32.854788 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:33.032655 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-d562e535-2d57-4f3f-91c4-3f95c9067885 req-c371f1f5-d752-4f3c-8634-ffb115ea1e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "name": "network-vif-plugged", "status": "completed", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:33.048244 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-d562e535-2d57-4f3f-91c4-3f95c9067885 req-c371f1f5-d752-4f3c-8634-ffb115ea1e5d service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:33.049232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-d562e535-2d57-4f3f-91c4-3f95c9067885 req-c371f1f5-d752-4f3c-8634-ffb115ea1e5d service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:33.076211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-d562e535-2d57-4f3f-91c4-3f95c9067885 req-c371f1f5-d752-4f3c-8634-ffb115ea1e5d service nova] Creating event network-vif-plugged:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:33:33.085833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-d562e535-2d57-4f3f-91c4-3f95c9067885 req-c371f1f5-d752-4f3c-8634-ffb115ea1e5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057333 Jun 21 18:33:33.090014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 392/775] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:33.168830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:33.169265 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:33.171405 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:33.178422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:33.181345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:33.183370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-924d5d2a-451c-4300-bb3d-d718a1125142 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.353749 Jun 21 18:33:33.195938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 384/776] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:32 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:33.202702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:33.203765 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:33.204840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:33.205667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:33.414338 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:33.427864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2e05f3a6-4152-42e5-baee-c6cdac9828c8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1365 microversion: 2.1 time: 0.265017 Jun 21 18:33:33.429140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 393/777] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:33 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:34.203740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:34.204641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:34.212448 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.212803 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.214822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.216718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.452485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:34.459862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:34.485531 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.488447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.491039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.492363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.500458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:34.510895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:34.512492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:34.513697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bba0fd5e-5790-4e46-b27f-2ad533d0451c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.314484 Jun 21 18:33:34.514263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 385/778] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:34 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:34.792735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:34.843674 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-58cd4220-dc8d-4aea-9600-109522ae9b2d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1555 microversion: 2.1 time: 0.399995 Jun 21 18:33:34.845516 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 394/779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:34 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1555 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:34.862881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:34.864710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:34.879536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.879994 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.881072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.885312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:35.353525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-731610a7-9b4b-4ae5-8fae-7b6551fda86e tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.495355 Jun 21 18:33:35.355079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 386/780] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:33:34 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-interface => generated 285 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:35.535498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:35.536898 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:35.555032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:35.555890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:35.556914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:35.557590 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:36.117090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:36.127348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:36.133500 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:36.137795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-606101e9-8132-451a-973d-967c916da8fd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.606306 Jun 21 18:33:36.141284 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 395/781] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:35 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:37.160744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:37.161638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:37.176305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:37.176865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:37.177907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:37.178750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:37.749133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:37.772892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:37.775789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:37.778062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a0c7bd02-3eee-4a67-bc04-12349693a68d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.621544 Jun 21 18:33:37.787012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 387/782] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:37 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:37.794793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-196d1622-5c73-4a09-b688-53074309742c req-8f0e23f1-f4cd-4147-bfd0-65dca64e415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c0bf4d-7121-4d96-a178-a61938b8dc31", "tag": "a67690e4-5041-4782-b992-443273622b1a"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:37.803559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-196d1622-5c73-4a09-b688-53074309742c req-8f0e23f1-f4cd-4147-bfd0-65dca64e415e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:37.804001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-196d1622-5c73-4a09-b688-53074309742c req-8f0e23f1-f4cd-4147-bfd0-65dca64e415e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:37.817532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-196d1622-5c73-4a09-b688-53074309742c req-8f0e23f1-f4cd-4147-bfd0-65dca64e415e service nova] Creating event network-changed:a67690e4-5041-4782-b992-443273622b1a for instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 on hv-cinder-83124 Jun 21 18:33:37.825559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-196d1622-5c73-4a09-b688-53074309742c req-8f0e23f1-f4cd-4147-bfd0-65dca64e415e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038391 Jun 21 18:33:37.826100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 396/783] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:38.802741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:38.803591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:38.819182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.819182 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:38.833627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.835862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:39.296492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:39.318303 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:39.328348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:39.329940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9b785fef-4c33-432f-ada3-c0228aa2a456 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.531223 Jun 21 18:33:39.330620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 388/784] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:38 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:40.360478 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:40.363073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:40.371703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:40.374543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:40.382841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:40.385472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:40.651821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:40.663731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:40.666811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:40.668732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e6d824c9-99ea-4be7-8f8d-6d2738315852 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.320821 Jun 21 18:33:40.670815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 397/785] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:40 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:41.702034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:41.708509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:41.738686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:41.744466 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:41.745747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:41.746254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:41.783276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:41.967231 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:41.989370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:41.992723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:41.992723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d25bc458-07fa-4f7f-b043-cca1a77b0b18 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.306142 Jun 21 18:33:42.028806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 389/786] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:41 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:43.013260 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:43.013879 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:43.021501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:43.021819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:43.022615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:43.023055 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:43.192171 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:43.201374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:43.204892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:43.206363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-71a5f2af-9515-4cc0-8bcb-e1d0c263f243 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.198768 Jun 21 18:33:43.207141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 398/787] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:43 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:44.226972 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:44.229136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:44.236181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:44.236712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:44.242997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:44.242997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:44.423327 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:44.434542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:44.437844 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:44.439287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3159ddbd-371f-4517-95c7-c280f31cdb3b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.216698 Jun 21 18:33:44.440043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 390/788] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:44 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:45.458980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:45.460600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:45.469365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:45.470178 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:45.471186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:45.471891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:45.654786 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:45.667646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:45.669196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:45.670482 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f3738cbc-bc0a-4979-83ee-d84fa5c0b315 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.215553 Jun 21 18:33:45.671050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 399/789] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:45 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:46.238899 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:46.239502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:46.246199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.246693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.247446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.247883 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.273691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lazy-loading 'flavor' on Instance uuid 48bcd7e7-55e0-4321-a994-c987c07f341c {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:46.676322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e11886a8-df6a-4ab4-b5d0-862e046a3f32 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "POST /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c/action" status: 202 len: 0 microversion: 2.1 time: 0.440814 Jun 21 18:33:46.677835 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 391/790] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:33:46 2022] POST /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:33:46.687475 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:46.688345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:46.699393 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:46.700779 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:46.708446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.708913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.709091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.709375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.709671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.710136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.710429 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.710976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.970642 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:46.979212 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0d0c364d-cc43-4c3d-8386-d1d38cd44c51 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.296220 Jun 21 18:33:46.979804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 400/791] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:46 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:47.004769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:47.023873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:47.026714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:47.028328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cc603143-5950-4199-a37d-9d318e933cbd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.337149 Jun 21 18:33:47.029318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 392/792] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:46 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:48.012048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:48.012681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:48.015214 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:48.020369 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.020853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.021657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.022097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.050359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:48.051639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:48.063171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.068042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.068042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.068042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.234406 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:48.244076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d222cf39-6fbb-4777-b2a2-eec87b370f10 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.236080 Jun 21 18:33:48.244726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 401/793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:48 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:48.259894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:48.268290 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:48.269757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:48.270944 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5d4bd683-b325-4bb0-942b-042d651380b0 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1739 microversion: 2.20 time: 0.227212 Jun 21 18:33:48.271498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 393/794] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:48 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:49.267097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:49.267685 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:49.276723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.282350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.282350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.282350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.291818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:49.292514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:49.299421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.299927 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.300968 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.301417 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.418427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.427277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-78db663b-53d6-493e-ad32-f83005339fd3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.164001 Jun 21 18:33:49.427876 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 402/795] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:49 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:49.444741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.453782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.455301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.456536 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b8645b38-d2dc-4788-ba60-b7050e6d5fb5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1721 microversion: 2.20 time: 0.169378 Jun 21 18:33:49.457287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 394/796] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:49 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:50.444087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:50.444884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:50.452634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.453085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.453862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.454390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.479185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:50.479949 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:50.486805 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.487245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.488039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.488502 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.617194 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.626073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-76df48be-4628-46ae-8501-f347697f678b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.185783 Jun 21 18:33:50.626745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 403/797] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:50 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:50.643082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.652762 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.654457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.655710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-35f71251-ea5f-4336-86e2-0425a173cb86 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1721 microversion: 2.20 time: 0.180595 Jun 21 18:33:50.656443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 395/798] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:50 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:33:51.645134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:51.645881 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:51.654114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.654577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.659179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.659179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.674603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:51.675212 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:51.678827 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:51.684830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.685410 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.686268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.686908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.806721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:51.822400 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4ebefbe3-2b85-4d89-bce9-28f20820774e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.180040 Jun 21 18:33:51.823495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 404/799] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:51 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:51.843535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:51.852449 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:51.853511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:51.854780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0ae28fdc-c873-4108-a057-86b5b340c3bc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1724 microversion: 2.20 time: 0.184064 Jun 21 18:33:51.855645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 396/800] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:51 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:51.872920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e83b08ec-5cf1-42e6-a394-8db6d2323e81"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:51.873994 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:51.880734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.881180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.881995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.882441 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.968357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=100 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:52.047470 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-b721c8b4-2297-4d82-ac00-400485d72930 req-0aa71813-e830-4eb8-a4a7-9f468e3bef4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "name": "network-vif-unplugged", "status": "completed", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:52.057184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b721c8b4-2297-4d82-ac00-400485d72930 req-0aa71813-e830-4eb8-a4a7-9f468e3bef4e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:52.057799 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-b721c8b4-2297-4d82-ac00-400485d72930 req-0aa71813-e830-4eb8-a4a7-9f468e3bef4e service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:52.070134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.compute.server_external_events [req-b721c8b4-2297-4d82-ac00-400485d72930 req-0aa71813-e830-4eb8-a4a7-9f468e3bef4e service nova] Unable to find a host for instance 4691899e-d090-41b8-928f-a73ce8a05719. Dropping event network-vif-unplugged {{(pid=118472) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 18:33:52.071063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-b721c8b4-2297-4d82-ac00-400485d72930 req-0aa71813-e830-4eb8-a4a7-9f468e3bef4e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027494 Jun 21 18:33:52.071660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 397/801] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 21 18:33:52.841279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:52.841936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:52.848773 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:52.849247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:52.850021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:52.850457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:52.997270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:53.005579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1b6d31bf-a903-4d1a-ae5c-42bd07a048c9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.168864 Jun 21 18:33:53.006165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 398/802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:52 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:53.216604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-60d0d7c0-a925-4ebc-8a6d-9f2957010188 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.347530 Jun 21 18:33:53.217671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 405/803] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Jun 21 18:33:51 2022] POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments => generated 188 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:33:53.337877 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:53.338372 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:53.344726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:53.345170 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:53.345954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:53.346381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.016300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3b984434-51fa-41d4-835c-ae7546de82f6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments/e83b08ec-5cf1-42e6-a394-8db6d2323e81" status: 202 len: 0 microversion: 2.20 time: 0.682974 Jun 21 18:33:54.017402 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 399/804] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Jun 21 18:33:53 2022] DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments/e83b08ec-5cf1-42e6-a394-8db6d2323e81 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:54.023621 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:54.024257 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:54.032613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.033073 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.033900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.034341 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.077530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:54.078155 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:54.084207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.084691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.085453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.085881 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.183217 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:54.191491 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d892624e-07d6-4a58-a686-de1c198f10d0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.172100 Jun 21 18:33:54.192109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 406/805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:54 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:54.316760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ac3cc167-b0a4-420f-aae1-9e0fe3e2884a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/action" status: 202 len: 0 microversion: 2.20 time: 0.244054 Jun 21 18:33:54.317441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 400/806] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Jun 21 18:33:54 2022] POST /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:33:54.327192 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:54.327817 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:54.334256 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.334721 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.335661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.336107 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.478326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:54.487724 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:54.492689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:54.492689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c59ed83d-a63f-4fd5-a427-fd177efcd18e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1672 microversion: 2.20 time: 0.168643 Jun 21 18:33:54.492689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 407/807] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:54 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:55.209614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:55.210483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:55.217431 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:55.217861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:55.218671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:55.219106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:55.225768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:55.384858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:55.393944 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-924b4944-441c-4179-b466-e2a2d5c6c8c4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.188626 Jun 21 18:33:55.398936 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 401/808] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:55 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:55.509844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:55.511211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:55.521433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:55.522412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:55.523828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:55.524583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:55.717716 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:55.726278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:55.727764 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:55.728993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-299119ab-fa57-4438-983a-cd5602dfb5a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1672 microversion: 2.20 time: 0.223865 Jun 21 18:33:55.729561 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 408/809] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:55 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:56.411625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:56.412357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:56.420613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:56.421120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:56.421925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:56.422363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:56.647236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:56.656158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-67f0659f-6dff-4ae9-aceb-b3eaa438a8f8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.248829 Jun 21 18:33:56.656777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 402/810] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:56 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:56.749228 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:56.750002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:56.757416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:56.758205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:56.759210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:56.759649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:56.939827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:56.948669 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:56.950747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:56.951939 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-552ad469-bc4e-465c-9c98-e2900f0ad961 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.208085 Jun 21 18:33:56.952536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 409/811] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:56 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:57.679329 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:57.680573 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:57.689867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:57.690632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:57.691941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:57.692714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:57.944181 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:57.954668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f9b07be2-cec2-4faf-af80-3d31180b2986 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.281415 Jun 21 18:33:57.966319 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 403/812] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:57 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:57.971128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:57.973031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:57.989066 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:57.989516 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:57.993117 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:57.993758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:58.164895 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:58.176518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:58.178727 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:58.181128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-79c822cd-4bf6-45c6-a4f8-5cb713f99bfe tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.213745 Jun 21 18:33:58.182471 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 410/813] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:57 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:33:58.977218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:58.978516 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:58.993049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:58.993821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:58.995238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:58.996622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:59.200751 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:59.202038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:59.203918 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:59.215951 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:59.217431 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c91dcb4a-22f2-449e-b0e6-9ed99ed05bc2 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.246362 Jun 21 18:33:59.218136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:59.218382 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 404/814] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:58 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:59.218957 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:59.219408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:59.415113 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:59.425455 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:59.427279 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:59.428766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-db0beb33-633f-4de6-a37f-991b1f6dc60c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.231529 Jun 21 18:33:59.429385 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 411/815] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:33:59 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:00.239703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:00.240526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:00.248766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:00.249216 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:00.250172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:00.250614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:00.425947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:00.434990 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-64a22e68-cd7f-4770-9b9f-1d0ce266969b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.199792 Jun 21 18:34:00.435693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 405/816] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:00 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:00.450496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:00.451166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:00.458219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:00.458672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:00.459639 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:00.460244 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:00.679842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:00.706315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:00.709325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:00.710965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dcc40d8e-1eac-41b9-b03d-697cb1218a7c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.264541 Jun 21 18:34:00.720002 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 412/817] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:00 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:01.452809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:01.453447 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:01.463432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:01.463888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:01.466029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:01.466642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:01.647852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:01.658507 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-83dd7272-f528-449c-9b39-b71dccb8f18e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.210116 Jun 21 18:34:01.659094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 406/818] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:01 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:01.731906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:01.732944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:01.742831 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:01.743283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:01.744306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:01.744962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:01.934070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:01.943893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:01.945979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:01.947196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bda578ac-4d4d-43dc-b5e1-e1a415b78387 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.221166 Jun 21 18:34:01.947756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 413/819] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:01 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:34:02.677049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:02.678593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:02.686312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:02.689286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:02.689286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:02.689286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:02.846597 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:02.862620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2fee3a60-71b1-47ed-9bab-5a246d2a7ca6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.189536 Jun 21 18:34:02.863214 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 407/820] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:02 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:02.967446 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:02.968053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:02.974632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:02.975072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:02.975890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:02.976346 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:03.146455 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:03.156382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:03.158186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:03.159387 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-375d3877-fdee-41cc-bbfe-f57754917ef4 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.196573 Jun 21 18:34:03.159980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 414/821] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:02 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:03.880035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:03.881917 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:03.892795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:03.893348 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:03.894248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:03.894758 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:04.047790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:04.073114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-deb94046-4129-45b2-804d-4436aeee4664 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.180498 Jun 21 18:34:04.073114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 408/822] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:03 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:04.179952 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:04.180762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:04.187886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:04.188344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:04.189211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:04.189650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:04.361135 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:04.371209 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:04.373463 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:04.374919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7dbbe004-e4e4-4564-ab6a-8e31daca6d77 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.199111 Jun 21 18:34:04.375492 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 415/823] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:04 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:05.086016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:05.086637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:05.094334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:05.095130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:05.096094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:05.096812 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:05.294801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:05.302745 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f8c3030b-4c72-4de3-b6ed-d964114b3232 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.221237 Jun 21 18:34:05.303323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 409/824] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:05 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:05.394592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:05.395443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:05.402486 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:05.402992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:05.403784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:05.404229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:05.564570 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:05.576166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:05.578320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:05.579756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e3ddef96-ca63-472c-9540-834129e86adf tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.189362 Jun 21 18:34:05.580604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 416/825] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:05 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:06.321234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:06.322054 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:06.329817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:06.330425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:06.331349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:06.331851 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:06.491940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:06.506828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e1bf6f87-ea98-4ccb-888c-57f4b893fbf6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.189122 Jun 21 18:34:06.507835 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 410/826] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:06 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:06.601007 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:06.601695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:06.609719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:06.610183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:06.610955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:06.611404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:06.769122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:06.781450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:06.783128 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:06.784447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-209e4fad-8e8a-463b-963d-acd9063d5903 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.187922 Jun 21 18:34:06.785071 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 417/827] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:06 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:07.524422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:07.525910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:07.531731 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:07.532237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:07.533189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:07.533631 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:07.697931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:07.706343 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cfdf8cb5-ad39-4fa5-b32b-c961376dea1b tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.185898 Jun 21 18:34:07.709509 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 411/828] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:07 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:07.803766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:07.804327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:07.811543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:07.811989 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:07.812845 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:07.813282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:07.958471 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:07.967075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:07.968586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:07.969747 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a8dab8d2-f640-465f-b1bd-5c5e82d6dc5b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.170025 Jun 21 18:34:07.970293 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 418/829] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:07 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:08.725144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:08.725795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:08.733632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:08.734251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:08.735157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:08.735697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:08.945600 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:08.955506 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6dbc097d-6b14-4038-834d-7d5e1ed14048 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.234272 Jun 21 18:34:08.956103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 412/830] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:08 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:08.991070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:08.991981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:09.000421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.001193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:09.001982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.002648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:09.144280 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:09.155020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:09.156096 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:09.157367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a28fa96e-14ab-4752-b08f-3fb14eb70d58 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.171681 Jun 21 18:34:09.157929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 419/831] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:08 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:09.974233 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:09.974924 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:09.981961 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.982393 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:09.983180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.983736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.143486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:10.154639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7bfaf136-6002-4cbe-a455-6884b218c24d tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.183853 Jun 21 18:34:10.155249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 413/832] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:09 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:10.175935 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:10.176620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:10.183627 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.184078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.185418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.185988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.188842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:10.331312 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:10.341579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:10.342896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:10.344106 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-114bc6a7-2026-419f-92c7-6adb4496296e tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.172257 Jun 21 18:34:10.345645 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 420/833] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:10 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:11.175312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:11.176222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:11.183476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.184045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.184976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.185889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.367248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:11.368616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:11.382407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.384909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.384909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.385304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.514976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:11.522981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a82b1323-c496-46dd-a1a9-859202df4dca tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.354345 Jun 21 18:34:11.523830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 414/834] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:11 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:11.539862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:11.549157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:11.550687 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:11.551837 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d82e0905-031f-413e-a535-4bf8e6d52044 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.191819 Jun 21 18:34:11.552427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 421/835] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:11 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:11.705755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:11.706581 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:11.714922 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.728528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.728528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.728528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.744463 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2314ceff-574c-4a4b-bc5f-1bf0eaa85441 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/ips" status: 200 len: 149 microversion: 2.1 time: 0.043856 Jun 21 18:34:11.745104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 415/836] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:34:11 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:12.543114 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:12.543878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:12.552760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.553252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.554038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.554533 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.573546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:12.574565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:12.582813 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.583272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.584074 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.584553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.727075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:12.737152 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:12.738295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d0f6d254-ce5f-43dd-8a57-3dd0e3363b1f tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1572 microversion: 2.1 time: 0.200129 Jun 21 18:34:12.739104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 422/837] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:12 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1572 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:12.746289 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:12.753723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:12.753723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7edb56fb-b2a0-469b-9120-d8988771b4dd tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.183835 Jun 21 18:34:12.753723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 416/838] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:12 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:12.763362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:12.763962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:12.770410 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.770862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.771636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.772080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.139709 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0694adf6-ec01-44ef-a66a-ebb753bb157e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "POST /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c/action" status: 202 len: 0 microversion: 2.1 time: 0.382896 Jun 21 18:34:13.140834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 423/839] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:34:12 2022] POST /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:13.154662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:13.159024 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:13.170655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:13.171139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.172620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:13.173673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.347290 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:13.354943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-50afc6d0-b1b2-41ae-a445-ed7a0341d9df tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1580 microversion: 2.1 time: 0.209342 Jun 21 18:34:13.355490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 417/840] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:13 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1580 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:13.770153 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:13.771006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:13.782239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:13.783077 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.784582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:13.785046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.928362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:13.936732 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:13.938339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:13.939423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-833691b0-244d-472b-a436-1548f9c9491d tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.173277 Jun 21 18:34:13.939978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 424/841] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:13 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:14.374145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:14.374809 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:14.381696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.382178 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.382935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.383375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.387517 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=100 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:14.444784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-da4363e6-363a-45e0-8b49-fef270fede9f req-498800ad-8af6-4eee-b104-4919960367e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "name": "network-vif-plugged", "status": "completed", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:14.454551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-da4363e6-363a-45e0-8b49-fef270fede9f req-498800ad-8af6-4eee-b104-4919960367e7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.455091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-da4363e6-363a-45e0-8b49-fef270fede9f req-498800ad-8af6-4eee-b104-4919960367e7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.469255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-da4363e6-363a-45e0-8b49-fef270fede9f req-498800ad-8af6-4eee-b104-4919960367e7 service nova] Creating event network-vif-plugged:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:34:14.474562 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-da4363e6-363a-45e0-8b49-fef270fede9f req-498800ad-8af6-4eee-b104-4919960367e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Jun 21 18:34:14.478677 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 425/842] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:34:14.523299 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:14.532452 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5f4455d9-b36a-4230-8bf6-b7f9c68f4213 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1580 microversion: 2.1 time: 0.163181 Jun 21 18:34:14.533029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 418/843] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:14 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:14.958428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:14.959901 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:14.968601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.969932 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.971838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.973098 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.120592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:15.121907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27ad8040-3141-4dbb-8a20-feaf4918026c"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:15.123725 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:15.129688 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:15.130263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.130714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.131187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:15.131486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.131923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.132331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-36d3f657-afc7-4dac-8cee-81c1ab38e68f tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.178839 Jun 21 18:34:15.132902 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 426/844] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:14 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:15.550036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:15.550566 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:15.556810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.557267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.558025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.558461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.700138 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:15.708452 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9f15c979-0596-4d61-b450-d31798af20c3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1522 microversion: 2.1 time: 0.162284 Jun 21 18:34:15.709037 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 427/845] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:15 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:16.045393 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e8c0848f-a400-4e30-9faa-e641f5342495 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "POST /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926805 Jun 21 18:34:16.050749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 419/846] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:34:15 2022] POST /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:34:16.161320 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:16.161925 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:16.169302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:16.174391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.174391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:16.174391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.309421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:16.318134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:16.319699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:16.320782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-44e7f851-267a-4751-b887-69e0869b5af6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.164075 Jun 21 18:34:16.321337 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 428/847] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:16 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:16.497706 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-a318919b-032a-43b8-81fa-3a97f3e55d03 req-bbc7fa0e-173a-460e-8869-3b03d8ace986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "name": "network-vif-unplugged", "status": "completed", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:16.523102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a318919b-032a-43b8-81fa-3a97f3e55d03 req-bbc7fa0e-173a-460e-8869-3b03d8ace986 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:16.523557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-a318919b-032a-43b8-81fa-3a97f3e55d03 req-bbc7fa0e-173a-460e-8869-3b03d8ace986 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.540039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.compute.server_external_events [req-a318919b-032a-43b8-81fa-3a97f3e55d03 req-bbc7fa0e-173a-460e-8869-3b03d8ace986 service nova] Unable to find a host for instance 48bcd7e7-55e0-4321-a994-c987c07f341c. Dropping event network-vif-unplugged {{(pid=118472) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 18:34:16.541114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-a318919b-032a-43b8-81fa-3a97f3e55d03 req-bbc7fa0e-173a-460e-8869-3b03d8ace986 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049192 Jun 21 18:34:16.545207 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 420/848] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 18:34:16.727119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:16.728522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:16.734983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:16.735425 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.736450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:16.737045 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.885239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:16.894529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-81d4c96c-2714-4ad9-9ba9-8283f82ad136 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1522 microversion: 2.1 time: 0.171249 Jun 21 18:34:16.895209 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 429/849] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:16 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:17.339281 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:17.340202 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:17.346591 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.347047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:17.347830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.348272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:17.491693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:17.500338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:17.502115 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:17.503533 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-83dcdefd-4b96-4b65-aefa-5f8895143b4a tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1730 microversion: 2.20 time: 0.167982 Jun 21 18:34:17.504079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 421/850] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:17 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:17.912352 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:17.917833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:17.922643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.923112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:17.924155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.924792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:18.068850 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:18.078297 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-21e11517-c0a6-484d-aa86-f11300703c5e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.169788 Jun 21 18:34:18.078906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 430/851] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:17 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:18.522674 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:18.523262 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:18.530621 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:18.531076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:18.531849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:18.532290 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:18.664728 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:18.673915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:18.675434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:18.677685 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fa653bad-e8c2-42b0-944e-206faf730814 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1717 microversion: 2.20 time: 0.158942 Jun 21 18:34:18.678247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 422/852] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:18 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:19.096198 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:19.096851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:19.099240 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=62 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:19.104216 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:19.104698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:19.105460 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:19.105895 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:19.246413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:19.254792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3043bad1-c003-4ad2-9cbc-1185d1abfa08 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.163175 Jun 21 18:34:19.255372 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 431/853] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:19 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:20.274476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:20.275607 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:20.282776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:20.283227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:20.284024 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:20.284489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:20.451355 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:20.459582 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a337de1e-ecd0-4013-9907-b5dfd3843097 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.188810 Jun 21 18:34:20.460433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 423/854] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:20 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:21.478383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:21.478994 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:21.486871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:21.487322 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:21.488091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:21.488580 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:21.643979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:21.651782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c858f4fa-280f-4ff1-a168-cef90114f7bc tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.177104 Jun 21 18:34:21.652484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 432/855] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:21 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:22.669282 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:22.669876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:22.672421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=58 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:22.677333 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:22.677777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:22.678534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:22.678966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:22.818723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:22.826887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b860004e-c39e-4ba3-9899-0fe2880a6382 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.161361 Jun 21 18:34:22.827450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 424/856] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:22 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:23.846056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:23.846874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:23.854035 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:23.854493 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:23.855324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:23.855722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:23.995072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:24.002854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9a7179a7-c410-48b3-8afc-31551676cecb tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.161543 Jun 21 18:34:24.003712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 433/857] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:23 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:24.776103 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:24.776652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:24.784651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:24.785101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:24.785979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:24.786479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:24.890126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'services' on Instance uuid d0c0bf4d-7121-4d96-a178-a61938b8dc31 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:34:25.021819 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:25.022675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:25.029803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.030362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.031825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.032271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.126784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-982eec9e-b364-441b-84f4-e83665c9bf11 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments/27ad8040-3141-4dbb-8a20-feaf4918026c" status: 202 len: 0 microversion: 2.1 time: 0.353321 Jun 21 18:34:25.131523 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 425/858] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:34:24 2022] DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments/27ad8040-3141-4dbb-8a20-feaf4918026c => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:25.144157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:25.145518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:25.159209 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.162545 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.162545 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.164800 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.196362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:25.206139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e434da2e-239d-4218-9a45-3f9e4ecb89e9 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.188483 Jun 21 18:34:25.207072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 434/859] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:25 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:25.214730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d2a0a45f-41e4-4ddb-bbfa-e017ef471ecb tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080579 Jun 21 18:34:25.220318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 426/860] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:34:25 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:26.227782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:26.228783 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.236809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.237350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:26.237938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.238373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.238840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.240659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.253083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.254712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.256146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.257271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.274134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-435133f7-3854-42f6-a9e5-509b61874270 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050443 Jun 21 18:34:26.275302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 435/861] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:34:26 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:34:26.342823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:26.343669 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.350521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.350849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.351694 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.352146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.369152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:26.381419 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:34:26.424555 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:26.438665 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6281708d-47b8-4a54-9c73-34369e4a18b0 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.207376 Jun 21 18:34:26.439734 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 427/862] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:26 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:26.690972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ed99d5b6-7288-4895-878d-79d83c9a2746 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 204 len: 0 microversion: 2.1 time: 0.352211 Jun 21 18:34:26.691563 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 436/863] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:34:26 2022] DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:34:26.699834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:26.700479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.706777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.707224 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.708005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.708501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.866877 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:26.876712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0b077fd0-e141-4b53-8d74-c9ab263caf48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1679 microversion: 2.1 time: 0.178929 Jun 21 18:34:26.876712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 428/864] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:26 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:27.458424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:27.459229 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:27.467404 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.467849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.469195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.469195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.606549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:27.614844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-763438b1-4697-44c4-8285-20bb9f700a48 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.161887 Jun 21 18:34:27.615416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 437/865] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:27 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:27.893558 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:27.894168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:27.900645 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.901089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.901850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.902277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:28.041267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:28.055638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2eb2f41b-b507-45c0-8003-8cb167b51963 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1679 microversion: 2.1 time: 0.166327 Jun 21 18:34:28.056219 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 429/866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:27 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:28.632258 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:28.632841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:28.639547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:28.640141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:28.642252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:28.642695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:28.795389 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:28.804560 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0dc2a5a8-d133-4ebf-9af4-0a2cecf17fc4 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.176498 Jun 21 18:34:28.805158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 438/867] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:28 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:28.865040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-7c0e0fd6-d583-4366-af11-d9b290c97ef2 req-7a4f6520-ce4d-4222-9cfa-e2061e3d54f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "name": "network-vif-plugged", "status": "completed", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:28.873634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7c0e0fd6-d583-4366-af11-d9b290c97ef2 req-7a4f6520-ce4d-4222-9cfa-e2061e3d54f5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:28.874225 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7c0e0fd6-d583-4366-af11-d9b290c97ef2 req-7a4f6520-ce4d-4222-9cfa-e2061e3d54f5 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:28.887158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-7c0e0fd6-d583-4366-af11-d9b290c97ef2 req-7a4f6520-ce4d-4222-9cfa-e2061e3d54f5 service nova] Creating event network-vif-plugged:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:34:28.892867 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-7c0e0fd6-d583-4366-af11-d9b290c97ef2 req-7a4f6520-ce4d-4222-9cfa-e2061e3d54f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Jun 21 18:34:28.894111 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 430/868] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:29.073877 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:29.074479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:29.081421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:29.091844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.091844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:29.091844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.166490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:29.175672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-828ad480-ea15-4e93-a812-d70b7032d9d1 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1612 microversion: 2.1 time: 0.105592 Jun 21 18:34:29.183010 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 439/869] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:29 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:29.706250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-996d6108-2180-4c35-bec9-7a6601754541 req-f63ad6bc-2dfc-4d0e-b3bb-1a644b57ef34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c0bf4d-7121-4d96-a178-a61938b8dc31", "name": "network-vif-deleted", "tag": "a67690e4-5041-4782-b992-443273622b1a"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:29.716908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-996d6108-2180-4c35-bec9-7a6601754541 req-f63ad6bc-2dfc-4d0e-b3bb-1a644b57ef34 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:29.717365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-996d6108-2180-4c35-bec9-7a6601754541 req-f63ad6bc-2dfc-4d0e-b3bb-1a644b57ef34 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.730898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-996d6108-2180-4c35-bec9-7a6601754541 req-f63ad6bc-2dfc-4d0e-b3bb-1a644b57ef34 service nova] Creating event network-vif-deleted:a67690e4-5041-4782-b992-443273622b1a for instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 on hv-cinder-83124 Jun 21 18:34:29.736826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-996d6108-2180-4c35-bec9-7a6601754541 req-f63ad6bc-2dfc-4d0e-b3bb-1a644b57ef34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Jun 21 18:34:29.741076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 431/870] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:29.821726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:29.822455 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:29.830049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:29.830509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.831273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:29.831705 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.987408 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:29.995781 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-04910ab1-73d5-48aa-bd52-c4b8b8e63dd6 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.178121 Jun 21 18:34:29.996359 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 440/871] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:29 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:30.195440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:30.196235 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:30.204039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:30.204634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:30.205421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:30.205856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:30.278642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:30.287978 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a055b0ed-5416-4cc3-97f1-fed5e97953ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1325 microversion: 2.1 time: 0.096914 Jun 21 18:34:30.289213 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 432/872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:30 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:31.013477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:31.014195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:31.021483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.021938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.022719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.023168 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.171756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:31.179664 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fa7e0498-e290-4bb3-a7ed-d1daede0906e tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1578 microversion: 2.1 time: 0.170100 Jun 21 18:34:31.180241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 441/873] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:31 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:31.316522 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:31.316522 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:31.322057 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.322630 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.323483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.323989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.360062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.360639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.363056 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lazy-loading 'fault' on Instance uuid d0c0bf4d-7121-4d96-a178-a61938b8dc31 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:34:31.408606 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c21b9f596da493fac827d3573833ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48dc636c17544593aaf2a2409c13e540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:31.416449 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f014942f-2360-47b7-a309-a044df4f5684 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 200 len: 1330 microversion: 2.1 time: 0.107905 Jun 21 18:34:31.417022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 433/874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:31 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:32.197886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:32.198505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:32.206540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.206984 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.207745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.208173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.347679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:32.355615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-04995bc1-f7d1-4135-9d64-d016217869af tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1565 microversion: 2.1 time: 0.161496 Jun 21 18:34:32.356235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 442/875] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:32 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:32.434540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:32.435130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:32.442209 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.442651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.443407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.443841 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 HTTP/1.1 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:32.459909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:32.461790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'd0c0bf4d-7121-4d96-a178-a61938b8dc31'} Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:32.462715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:32.464661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:32.466159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:32.466159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1ff2d614-c1ab-45cd-994b-0f1e733af3ce tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 404 len: 111 microversion: 2.1 time: 0.030067 Jun 21 18:34:32.466159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 434/876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:32 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:32.470737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d11cf8dc-c286-458d-892f-58196aebbc48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '.version_select at 0x7fd39c173670>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:32.623082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d11cf8dc-c286-458d-892f-58196aebbc48 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226360494" status: 202 len: 0 microversion: 2.1 time: 0.157075 Jun 21 18:34:32.623831 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 443/877] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:34:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226360494 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:34.675911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:34.676481 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:34.682606 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.683048 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.683966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.684655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.689715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:34.699418 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 HTTP/1.1 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:34.701519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.703705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'd0c0bf4d-7121-4d96-a178-a61938b8dc31'} Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:34.704716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.706184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.707689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:34.707689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-162c85d8-96e6-4e13-9301-9eea099aa84f tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jun 21 18:34:34.707689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 435/878] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:34:34 2022] DELETE /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:34.711900 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:34.712546 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: d0c0bf4d-7121-4d96-a178-a61938b8dc31] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:34.719633 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.720090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.720916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.721357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.736110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 HTTP/1.1 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:34:34.737840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.739745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'd0c0bf4d-7121-4d96-a178-a61938b8dc31'} Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:34.741207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. Jun 21 18:34:34.742822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:34.744072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance d0c0bf4d-7121-4d96-a178-a61938b8dc31 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:34.744072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-597b9937-cfd8-4f52-922c-6fb1e03c604d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31" status: 404 len: 111 microversion: 2.1 time: 0.031145 Jun 21 18:34:34.744072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 444/879] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:34 2022] GET /compute/v2.1/servers/d0c0bf4d-7121-4d96-a178-a61938b8dc31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:36.016455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.016989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.024232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.024715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.025492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.025931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.039934 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d HTTP/1.1 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:36.041528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.043298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '5ea73404-9343-4057-868c-7ee3c41c736d'} Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:36.044198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.045736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.047370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:36.047370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8be66d2a-e49d-42b0-9ebd-984938cb6225 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 404 len: 111 microversion: 2.1 time: 0.031229 Jun 21 18:34:36.047370 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 436/880] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:34:36 2022] DELETE /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:36.052020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.052659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 5ea73404-9343-4057-868c-7ee3c41c736d] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.059138 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.059591 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.060418 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.060874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.074233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d HTTP/1.1 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:34:36.075760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.079224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '5ea73404-9343-4057-868c-7ee3c41c736d'} Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:36.080118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. Jun 21 18:34:36.081623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.082934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 5ea73404-9343-4057-868c-7ee3c41c736d could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:36.082934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-cf51948c-0c85-4fd5-9f6e-c039a8e9902d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d" status: 404 len: 111 microversion: 2.1 time: 0.028978 Jun 21 18:34:36.082934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 445/881] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:36 2022] GET /compute/v2.1/servers/5ea73404-9343-4057-868c-7ee3c41c736d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:34:36.087382 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.087952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.096689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.097512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.098904 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.099704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.116278 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 HTTP/1.1 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:36.117869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.119887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '92ef497d-b88f-46b1-a17e-badb7fb350f4'} Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:36.121130 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.122760 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.124302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:36.124302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2b4b2f93-28d0-4a5b-989e-3bf514bfb3af tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 404 len: 111 microversion: 2.1 time: 0.036716 Jun 21 18:34:36.124302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 437/882] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:34:36 2022] DELETE /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:34:36.129461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.130143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: 92ef497d-b88f-46b1-a17e-badb7fb350f4] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.136460 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.136916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.137692 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.138211 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.152580 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 HTTP/1.1 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:34:36.154104 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.155843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '92ef497d-b88f-46b1-a17e-badb7fb350f4'} Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:36.156653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. Jun 21 18:34:36.158277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:36.159731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance 92ef497d-b88f-46b1-a17e-badb7fb350f4 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:36.159731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c4383bc1-2725-4292-889c-726df68ccbf8 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4" status: 404 len: 111 microversion: 2.1 time: 0.031610 Jun 21 18:34:36.159731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 446/883] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:36 2022] GET /compute/v2.1/servers/92ef497d-b88f-46b1-a17e-badb7fb350f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:37.536119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:37.537088 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:37.543498 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.543941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.544754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.545167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.558957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 HTTP/1.1 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:37.560519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.562161 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'db6b7d00-7d63-4188-a97f-783156275509'} Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:37.563097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.565146 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.566723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:37.566723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-72a126ae-6dec-4a94-86d4-bd1beedfd991 tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jun 21 18:34:37.566723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 438/884] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:34:37 2022] DELETE /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:37.571483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:37.576374 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] [instance: db6b7d00-7d63-4188-a97f-783156275509] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:37.578523 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.578964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.580938 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.581375 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.594565 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] HTTP exception thrown: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Request method failure captured: Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 HTTP/1.1 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2EEaEACzABSt1pvA9ryR1KJTEb1D0Aq4_lYz_8irhfwRTK1ucd8oAM9u-2DF87_Cb_kpDY1jlhxRTwzmgWX34V9IT8_fYUcegOOkBthwB_eNA3-EEywj-jPhuOt26cdCxrh5Y3jSB-ecNZe_QwInMHyDuOlPFLnDj5gsgHBttHj64 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:34:37.596623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48dc636c17544593aaf2a2409c13e540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48dc636c17544593aaf2a2409c13e540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 48dc636c17544593aaf2a2409c13e540 Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264468366 Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5c21b9f596da493fac827d3573833ed1 Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeNegativeTest-1264468366-project Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.598415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'db6b7d00-7d63-4188-a97f-783156275509'} Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:37.599246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. Jun 21 18:34:37.600494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:37.606262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] Returning 404 to user: Instance db6b7d00-7d63-4188-a97f-783156275509 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:37.606262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c3b85c8b-4e4b-43e9-9a12-b798ffb3797d tempest-AttachVolumeNegativeTest-1264468366 tempest-AttachVolumeNegativeTest-1264468366-project] 10.222.0.23 "GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509" status: 404 len: 111 microversion: 2.1 time: 0.030318 Jun 21 18:34:37.606262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 447/885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:37 2022] GET /compute/v2.1/servers/db6b7d00-7d63-4188-a97f-783156275509 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:44.015529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1930ed83-0dce-4974-a2f9-7140af30e844 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Action: 'create', calling method: .version_select at 0x7fd39c4b0670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1772617685", "metadata": {"Type": "work"}}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:44.828220 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1930ed83-0dce-4974-a2f9-7140af30e844 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.950020 Jun 21 18:34:44.828894 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 439/886] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Jun 21 18:34:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 951 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 18:34:44.842893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-28f67202-fec0-4ed2-bce4-3923c6e3ca26 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd39770fdc0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:44.905833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-28f67202-fec0-4ed2-bce4-3923c6e3ca26 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 200 len: 353 microversion: 2.1 time: 0.068428 Jun 21 18:34:44.906416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 448/887] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:34:44 2022] GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:45.920634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ea8a1252-43ae-4277-8451-e4fd57e6f9f8 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd396e60160>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:45.973164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ea8a1252-43ae-4277-8451-e4fd57e6f9f8 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 200 len: 354 microversion: 2.1 time: 0.057181 Jun 21 18:34:45.973742 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 440/888] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:34:45 2022] GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:45.986497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0332b1f0-9949-4100-91fa-b26028801ff4 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd3977255e0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:46.041653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0332b1f0-9949-4100-91fa-b26028801ff4 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 200 len: 354 microversion: 2.1 time: 0.060284 Jun 21 18:34:46.042227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 449/889] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:34:45 2022] GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:46.060892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f9909a6b-5fcc-4936-b6cb-1598d16a57c7 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd39c109e50>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:46.295500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f9909a6b-5fcc-4936-b6cb-1598d16a57c7 tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 202 len: 0 microversion: 2.1 time: 0.238582 Jun 21 18:34:46.296260 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 441/890] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:34:46 2022] DELETE /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:46.304617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d15b29d2-14df-4e1b-9202-43edd88ec9af tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd397724310>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:46.357109 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d15b29d2-14df-4e1b-9202-43edd88ec9af tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 200 len: 353 microversion: 2.1 time: 0.056614 Jun 21 18:34:46.357682 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 450/891] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:34:46 2022] GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:47.374923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1a53d733-f031-4ddb-bac9-2833a184cbeb tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Calling method '.version_select at 0x7fd396feb9d0>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:47.403534 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-1a53d733-f031-4ddb-bac9-2833a184cbeb tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] HTTP exception thrown: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1a53d733-f031-4ddb-bac9-2833a184cbeb tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Request method failure captured: Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc HTTP/1.1 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg9D3jpkUYyUaJlfk08nOuamOqVBGwHFOELNt3wmaH714JfwehZgqFgrzJjOTtRBG56rqPPiS6gGOn0iQEcQuOqTLBY3u_jhqdzKpDoBJzJc356F0bGf0D8nCQPsxUvxIALOfhQb2Rblfri5PMSYBnjg3V9Q91CZEA_Nql5YH1N1zo8 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 9a77280a811a48ab852f1359cb453e4c Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesGetTestJSON-1008787508 Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:34:47.405577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a77280a811a48ab852f1359cb453e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a77280a811a48ab852f1359cb453e4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a77280a811a48ab852f1359cb453e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a77280a811a48ab852f1359cb453e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesGetTestJSON-1008787508 Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 9a77280a811a48ab852f1359cb453e4c Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesGetTestJSON-1008787508 Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesGetTestJSON-1008787508-project Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: ecb3f1339485405aaeaf374c2d73361b Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesGetTestJSON-1008787508-project Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'e5c7abaa-417e-4b18-8dc7-24e465d1e5dc'} Jun 21 18:34:47.407365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. (HTTP 404) (Request-ID: req-6213cf30-a733-4576-bfff-ddca31d355b6) Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:47.412304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:34:47.414312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:34:47.416707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1a53d733-f031-4ddb-bac9-2833a184cbeb tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] Returning 404 to user: Volume e5c7abaa-417e-4b18-8dc7-24e465d1e5dc could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1a53d733-f031-4ddb-bac9-2833a184cbeb tempest-VolumesGetTestJSON-1008787508 tempest-VolumesGetTestJSON-1008787508-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc" status: 404 len: 109 microversion: 2.1 time: 0.036586 Jun 21 18:34:47.418518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 442/892] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Jun 21 18:34:47 2022] GET /compute/v2.1/os-volumes/e5c7abaa-417e-4b18-8dc7-24e465d1e5dc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:49.006323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:49.007223 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:49.011735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1549760440", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "networks": [{"uuid": "071eec2e-b697-449b-8df0-f3b475d6a75d"}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:49.070964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] validate_networks() for [('071eec2e-b697-449b-8df0-f3b475d6a75d', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:34:49.434507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:34:49.434921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:34:49.435389 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:34:49.435929 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:34:49.436294 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:34:49.446258 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.446710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.447700 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.448193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.466583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Getting quotas for project 20016956d3e2409cb41b02f7f0617daa. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:34:49.470770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Getting quotas for user 78a853ef1e51411e88ec7984693be865 and project 20016956d3e2409cb41b02f7f0617daa. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:34:49.481960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:34:49.487617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:34:49.652722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-42616537-420e-4740-ab97-718317fcebf1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649135 Jun 21 18:34:49.653851 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 451/893] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:34:49.661375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=31 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:49.662519 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:49.667705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ff8a3901-2e15-4544-a63a-951c87cee66b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:49.668423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ff8a3901-2e15-4544-a63a-951c87cee66b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:49.735013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ff8a3901-2e15-4544-a63a-951c87cee66b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:49.743064 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ff8a3901-2e15-4544-a63a-951c87cee66b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1219 microversion: 2.1 time: 0.083045 Jun 21 18:34:49.743624 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 443/894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:49 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:50.761776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d8188a52-7df9-4e54-b8fe-94b12697c891 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:50.762397 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d8188a52-7df9-4e54-b8fe-94b12697c891 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:50.823465 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d8188a52-7df9-4e54-b8fe-94b12697c891 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:50.833181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d8188a52-7df9-4e54-b8fe-94b12697c891 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1219 microversion: 2.1 time: 0.076039 Jun 21 18:34:50.833804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 452/895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:50 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:51.852073 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:51.852723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:51.865944 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:51.866143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:51.866818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:51.867248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:51.932767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:51.940239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d3fb5bd5-29ae-4403-a09f-09819e81cab0 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1271 microversion: 2.1 time: 0.093554 Jun 21 18:34:51.940824 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 444/896] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:51 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:52.673027 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:52.674386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:52.682355 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.683122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.683911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.684352 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.716623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f1f14f03-be25-432c-9b73-667f7f170e60 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049425 Jun 21 18:34:52.717215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 453/897] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Jun 21 18:34:52 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:52.787521 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:52.788021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:52.794267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.794756 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.795518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.796013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.822980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:34:52.958126 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:52.961499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:52.964955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.965411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.966176 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.966613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.107537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.115632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-219031e6-c8cd-4a09-a700-a4f17721ce42 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.161909 Jun 21 18:34:53.116246 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 454/898] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:52 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:53.170720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cb2d4607-b958-4934-955d-ee6e4ed9081c tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 204 len: 0 microversion: 2.20 time: 0.388106 Jun 21 18:34:53.173675 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 445/899] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jun 21 18:34:52 2022] DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 18:34:53.181519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:53.182427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:53.188728 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.189407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.190272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.190894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.345080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.356443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.360182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.361478 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e61bfe78-2abb-4ac3-9328-d3e9ed6a335b tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.184236 Jun 21 18:34:53.362124 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 455/900] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:53 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:34:53.955911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-0cf0428f-d88b-4255-b21c-4826d0b321fa req-51d9579f-6fee-4703-99d7-9b4af4ca6c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1023826-c337-4ae6-8a55-df1b85bcf610", "tag": "13ac0674-9166-43e7-b5fa-da5864ee9141"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:53.968838 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0cf0428f-d88b-4255-b21c-4826d0b321fa req-51d9579f-6fee-4703-99d7-9b4af4ca6c11 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.969556 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0cf0428f-d88b-4255-b21c-4826d0b321fa req-51d9579f-6fee-4703-99d7-9b4af4ca6c11 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.984318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-0cf0428f-d88b-4255-b21c-4826d0b321fa req-51d9579f-6fee-4703-99d7-9b4af4ca6c11 service nova] Creating event network-changed:13ac0674-9166-43e7-b5fa-da5864ee9141 for instance d1023826-c337-4ae6-8a55-df1b85bcf610 on hv-cinder-83124 Jun 21 18:34:53.989357 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-0cf0428f-d88b-4255-b21c-4826d0b321fa req-51d9579f-6fee-4703-99d7-9b4af4ca6c11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039009 Jun 21 18:34:53.989956 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 446/901] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:54.133215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:54.133767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:54.140945 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.144467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.144467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.144467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.286490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.294615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ef946c14-8f8a-4a60-b8cf-511fc5d3facb tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.165519 Jun 21 18:34:54.295886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 456/902] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:54 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:54.382514 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:54.384248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:54.393850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.394491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.396157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.396626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.582110 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.595479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.601716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.601716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-afe7e9b4-ffa1-4615-9f05-2452c78a66cb tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1723 microversion: 2.20 time: 0.222869 Jun 21 18:34:54.601716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 447/903] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:54 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:55.313156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:55.313968 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:55.321625 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.322243 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.323063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.323498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.570736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.581348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a93a5ba0-8360-4986-a030-bcd8c4f016a5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.272757 Jun 21 18:34:55.589500 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 457/904] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:55 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:55.620802 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:55.622439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:55.634096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.634718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.635626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.636221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.729806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.743421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.745017 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.746218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-17e5e9d2-10aa-4a32-9164-0f6d1243f9a6 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1656 microversion: 2.20 time: 0.130605 Jun 21 18:34:55.746783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 448/905] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:55 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1656 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:34:55.966631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b7af8883-cb5e-4479-9d5c-d074b8da8d81 req-107332fd-396a-4f44-a522-ee8ba4083bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4691899e-d090-41b8-928f-a73ce8a05719", "name": "network-vif-deleted", "tag": "72a6bff5-d93f-4fd4-8ec5-232090d7474d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:55.976729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b7af8883-cb5e-4479-9d5c-d074b8da8d81 req-107332fd-396a-4f44-a522-ee8ba4083bba service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.978003 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b7af8883-cb5e-4479-9d5c-d074b8da8d81 req-107332fd-396a-4f44-a522-ee8ba4083bba service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.005378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b7af8883-cb5e-4479-9d5c-d074b8da8d81 req-107332fd-396a-4f44-a522-ee8ba4083bba service nova] Creating event network-vif-deleted:72a6bff5-d93f-4fd4-8ec5-232090d7474d for instance 4691899e-d090-41b8-928f-a73ce8a05719 on hv-cinder-83124 Jun 21 18:34:56.014177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b7af8883-cb5e-4479-9d5c-d074b8da8d81 req-107332fd-396a-4f44-a522-ee8ba4083bba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051894 Jun 21 18:34:56.015328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 458/906] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:56.603369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:56.605081 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:56.616294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.617107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.618082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.619133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.773283 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:56.775423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:56.786748 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.787206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.788723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.789169 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.835906 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.836373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.837839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lazy-loading 'fault' on Instance uuid 4691899e-d090-41b8-928f-a73ce8a05719 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:34:56.901075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.917043 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.919501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b20ea1c1-6ed6-4cd2-ad25-328e10854801 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.322962 Jun 21 18:34:56.929272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 449/907] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:56 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:56.939411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.943060 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e03c3a73166b4bbe9fca6d18ecf59221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227bb7e0aca249aea1d7bf2ecb2903e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.945165 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dddbe823-d06b-4dc9-aecd-082f5879d558 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 200 len: 1371 microversion: 2.20 time: 0.179331 Jun 21 18:34:56.946356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 459/908] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:56 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:34:57.945211 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:57.945915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:57.953109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.953579 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.954358 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.954787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.970378 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:57.980924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:57.980924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.980924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.981520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.981802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.997715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 HTTP/1.1 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:34:57.999414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:34:58.001265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '4691899e-d090-41b8-928f-a73ce8a05719'} Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:34:58.002323 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:34:58.004157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:34:58.005894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:34:58.005894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3c35fce5-0967-4718-9eed-4e928e329b23 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 404 len: 111 microversion: 2.20 time: 0.034575 Jun 21 18:34:58.005894 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 460/909] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:34:57 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 18:34:58.012933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e81cebd8-d117-4295-8b61-4cfaa0d2d276 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '.version_select at 0x7fd397724820>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:58.075712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e81cebd8-d117-4295-8b61-4cfaa0d2d276 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175662366" status: 204 len: 0 microversion: 2.20 time: 0.068638 Jun 21 18:34:58.077135 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 461/910] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Jun 21 18:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175662366 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 21 18:34:58.123188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:58.131660 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-57abbc0c-4a0b-466e-92f1-ea3b062d7717 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.190531 Jun 21 18:34:58.132535 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 450/911] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:57 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:59.150871 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:59.151699 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:59.161177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:59.161653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:59.162499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:59.162954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:59.216150 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-fbdc4d68-6881-4eb9-9c90-b407c4e11ced req-bc6a91de-9a2d-458e-b007-37bb0ee8b01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1023826-c337-4ae6-8a55-df1b85bcf610", "name": "network-vif-plugged", "status": "completed", "tag": "13ac0674-9166-43e7-b5fa-da5864ee9141"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:59.236948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbdc4d68-6881-4eb9-9c90-b407c4e11ced req-bc6a91de-9a2d-458e-b007-37bb0ee8b01a service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:59.237614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-fbdc4d68-6881-4eb9-9c90-b407c4e11ced req-bc6a91de-9a2d-458e-b007-37bb0ee8b01a service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:59.255686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-fbdc4d68-6881-4eb9-9c90-b407c4e11ced req-bc6a91de-9a2d-458e-b007-37bb0ee8b01a service nova] Creating event network-vif-plugged:13ac0674-9166-43e7-b5fa-da5864ee9141 for instance d1023826-c337-4ae6-8a55-df1b85bcf610 on hv-cinder-83124 Jun 21 18:34:59.271158 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-fbdc4d68-6881-4eb9-9c90-b407c4e11ced req-bc6a91de-9a2d-458e-b007-37bb0ee8b01a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066176 Jun 21 18:34:59.271939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 451/912] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:59.393919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:59.408051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-453ce185-cffd-46c3-9105-5135bc67d5b7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.261598 Jun 21 18:34:59.411631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 462/913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:59 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:00.360443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:00.366033 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:00.366732 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:00.373025 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.373482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.374293 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.374730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.389018 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 HTTP/1.1 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:35:00.390752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.393187 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '4691899e-d090-41b8-928f-a73ce8a05719'} Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:00.394145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.395687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.397964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:00.397964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ecc0eae3-0674-49f4-a3c2-37e6e2184db5 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 404 len: 111 microversion: 2.20 time: 0.032682 Jun 21 18:35:00.397964 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 452/914] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jun 21 18:35:00 2022] DELETE /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:35:00.402150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:00.402759 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 4691899e-d090-41b8-928f-a73ce8a05719] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:00.404766 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:00.410140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.410589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.411367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.412574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.426833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.427082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:00.427794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 HTTP/1.1 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:35:00.428424 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.430274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '4691899e-d090-41b8-928f-a73ce8a05719'} Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:00.431185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. Jun 21 18:35:00.433179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:00.445826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 4691899e-d090-41b8-928f-a73ce8a05719 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:00.445826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-72cbe932-6319-4eca-a562-7a8a26d5f1a3 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719" status: 404 len: 111 microversion: 2.20 time: 0.031572 Jun 21 18:35:00.445826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 463/915] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:35:00 2022] GET /compute/v2.1/servers/4691899e-d090-41b8-928f-a73ce8a05719 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:35:00.446542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.446542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.446542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.446542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.579363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:00.589083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a29f903e-1ac4-44c9-bf35-5df15b785e97 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1319 microversion: 2.1 time: 0.165887 Jun 21 18:35:00.589883 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 453/916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:00 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:01.606492 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:01.607235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:01.609367 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=8 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:01.615643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.615643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.616535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.616980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.774402 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:01.776679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:01.777222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:01.782149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-42beae5f-8343-496d-a022-26a98fd61514 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1508 microversion: 2.1 time: 0.179558 Jun 21 18:35:01.782730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 464/917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:01 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:01.783776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.784234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.785149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.785589 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.799804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 HTTP/1.1 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:35:01.801407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.803323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '9085b7c8-6dc8-496a-8611-b3e18c5f2e69'} Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:01.804492 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.806132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.808001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:01.808001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8c74dbf3-11e3-4b02-8cbd-8cb93221e183 tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 404 len: 111 microversion: 2.20 time: 0.030087 Jun 21 18:35:01.808001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 454/918] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Jun 21 18:35:01 2022] DELETE /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 18:35:01.812657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:01.813267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] [instance: 9085b7c8-6dc8-496a-8611-b3e18c5f2e69] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:01.820236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.820769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.821553 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:01.821980 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:01.839704 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] HTTP exception thrown: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Request method failure captured: Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 HTTP/1.1 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg2E7YYCVy8fZRG0kDsTOxNlb9IAtHAmeDdBjYewg1QT8KttB2eU1JmWCR5olNoSyiNuICS9I-i-6UnhW4nR7xaZGFYOTb8N6XaU0WM9FyGKHl0q-ZnN9c-euVfdLnqpBvq6Xy79kwi2O8ZboiHm880SKMcZkyM2Gph7y6vEh8wUrwc Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:35:01.841708 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/227bb7e0aca249aea1d7bf2ecb2903e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 227bb7e0aca249aea1d7bf2ecb2903e9 Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1735826902 Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: e03c3a73166b4bbe9fca6d18ecf59221 Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1735826902-project Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.843423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '9085b7c8-6dc8-496a-8611-b3e18c5f2e69'} Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:01.844326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. Jun 21 18:35:01.846287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:01.847794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] Returning 404 to user: Instance 9085b7c8-6dc8-496a-8611-b3e18c5f2e69 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:01.847794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-25b24936-c163-4ecf-ac24-709bc0874fcc tempest-AttachVolumeShelveTestJSON-1735826902 tempest-AttachVolumeShelveTestJSON-1735826902-project] 10.222.0.23 "GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69" status: 404 len: 111 microversion: 2.20 time: 0.034022 Jun 21 18:35:01.847794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 465/919] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Jun 21 18:35:01 2022] GET /compute/v2.1/servers/9085b7c8-6dc8-496a-8611-b3e18c5f2e69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:35:17.112424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:17.113301 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:17.303913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: .version_select at 0x7fd396feb430>, body: {"keypair": {"name": "tempest-keypair-702166396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmQ8956u2d0hV3nzThcrTqXjNabGXcdfxc44Z+07rYFX8qMyIinZm08h/KtQv8WRRP4URqBAR/CVQatE3dR7VcpmK1AYUaE9xgzuc/fmTpoBmMHGbb8dDTDCOa7YySTug=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:17.335373 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for project 466c7ed97ff34cd7824164207ab764d0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:35:17.342192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for user 5b424248bfb84fe4a25269232e08dcaf and project 466c7ed97ff34cd7824164207ab764d0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:35:17.364680 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [55e2a5af-4751-464e-86ce-36c3f2376fce] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:35:18.373871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [55e2a5af-4751-464e-86ce-36c3f2376fce] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34708. Jun 21 18:35:18.481124 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bf115f33-5337-469e-a2f8-fab01366af81 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.373975 Jun 21 18:35:18.485616 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 455/920] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:35:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:35:18.780965 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea5084d7-a643-4513-a64f-cdbdb2697022", "device": "/dev/sdb"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:18.782568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:18.787130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:18.787802 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=60 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:18.791937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:18.792484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:18.793219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:18.793833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:19.855695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ca1a3b9a-2ce0-45bb-9d56-857a2a0b3fa5 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "POST /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078676 Jun 21 18:35:19.863809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 466/921] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:35:18 2022] POST /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:21.670720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1752180586", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5780ac4-4d57-4ab3-99d1-850208be45a3"}], "security_groups": [{"name": "tempest-securitygroup--1024287741"}], "key_name": "tempest-keypair-702166396", "user_data": "}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:21.790373 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] validate_networks() for [('b5780ac4-4d57-4ab3-99d1-850208be45a3', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:35:22.218686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:35:22.219116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:35:22.219598 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:35:22.220012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:35:22.220449 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:35:22.231595 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:22.232157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:22.232784 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:22.233246 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:22.255565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for project 466c7ed97ff34cd7824164207ab764d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:35:22.260275 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for user 5b424248bfb84fe4a25269232e08dcaf and project 466c7ed97ff34cd7824164207ab764d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:35:22.275998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:35:22.275998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:35:22.445862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-86b9fe3c-0957-41d5-b9c5-043748c2f89a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779963 Jun 21 18:35:22.446529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 456/922] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:35:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:35:22.459597 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c2d5fdb4-2bcc-4318-9264-e8e22d2d1432 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:22.460558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c2d5fdb4-2bcc-4318-9264-e8e22d2d1432 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:22.523163 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c2d5fdb4-2bcc-4318-9264-e8e22d2d1432 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:22.533059 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c2d5fdb4-2bcc-4318-9264-e8e22d2d1432 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1237 microversion: 2.1 time: 0.078991 Jun 21 18:35:22.533948 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 467/923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:22 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:23.552446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c51fafa2-40b4-4f74-b850-6f334d5148f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:23.553082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c51fafa2-40b4-4f74-b850-6f334d5148f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:23.619132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c51fafa2-40b4-4f74-b850-6f334d5148f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:23.626277 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c51fafa2-40b4-4f74-b850-6f334d5148f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1237 microversion: 2.1 time: 0.078161 Jun 21 18:35:23.626851 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 457/924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:23 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:24.644230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:24.644863 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:24.653087 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:24.653548 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:24.654345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:24.654808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:24.727505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:24.735248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-01451b66-1095-4109-b6f8-c435fa444323 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1289 microversion: 2.1 time: 0.094967 Jun 21 18:35:24.735833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 468/925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:24 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:25.759368 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:25.760120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:25.767865 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:25.768470 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:25.769817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:25.770644 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:25.848065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:25.857808 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d92fb5a6-3f65-4a0e-84f5-41d8c840d6bc tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1295 microversion: 2.1 time: 0.105538 Jun 21 18:35:25.858738 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 458/926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:25 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:26.879138 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:26.879138 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:26.907105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:26.907988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:26.915159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:26.915159 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:27.077306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:27.085097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8040926e-cce3-4fa7-86aa-cf55b4e717d8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.213234 Jun 21 18:35:27.085682 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 469/927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:26 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:27.187249 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ea523ed0-0b19-4004-8637-4acc8569fff2 req-cc0752f4-7946-4b51-a21c-5f33fa56427b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff510c5-0fac-44d2-8c03-adc9c7952b43", "tag": "1b3eda2f-f745-4c51-9123-729b8664a84d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:27.198423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ea523ed0-0b19-4004-8637-4acc8569fff2 req-cc0752f4-7946-4b51-a21c-5f33fa56427b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:27.198875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ea523ed0-0b19-4004-8637-4acc8569fff2 req-cc0752f4-7946-4b51-a21c-5f33fa56427b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:27.211294 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ea523ed0-0b19-4004-8637-4acc8569fff2 req-cc0752f4-7946-4b51-a21c-5f33fa56427b service nova] Creating event network-changed:1b3eda2f-f745-4c51-9123-729b8664a84d for instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 on hv-cinder-83124 Jun 21 18:35:27.217941 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ea523ed0-0b19-4004-8637-4acc8569fff2 req-cc0752f4-7946-4b51-a21c-5f33fa56427b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Jun 21 18:35:27.219026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 459/928] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:28.103265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:28.104253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:28.111325 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:28.111919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:28.112780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:28.113238 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:28.385351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:28.393794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ab58caa2-ee18-4d50-a962-716baa7fdac7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.295010 Jun 21 18:35:28.394389 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 470/929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:28 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:29.420230 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:29.421378 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:29.429911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:29.430511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:29.431688 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:29.432234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:29.605095 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:29.613673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ad7ccdae-87c1-4ed9-9812-682354920413 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.204161 Jun 21 18:35:29.614315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 460/930] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:29 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:30.634536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:30.648150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:30.655499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:30.656495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:30.657606 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:30.658366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:30.814452 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:30.824354 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9e56929f-a765-48a1-a2ae-f1f51385eda3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.196533 Jun 21 18:35:30.824987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 471/931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:30 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:31.843064 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:31.843749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:31.853013 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:31.853815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:31.855178 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:31.855649 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:32.070397 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:32.079840 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1a1b50fd-5b51-44be-b353-a3edf266c87e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.240780 Jun 21 18:35:32.080477 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 461/932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:31 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:33.110592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:33.111855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:33.122076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:33.125272 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:33.125976 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:33.127770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:33.128934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:33.324031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:33.337730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0ff7601f-29d5-48dc-82ce-265725d8d3c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.233476 Jun 21 18:35:33.338760 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 472/933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:33 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:33.507247 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-7b173cbd-5a1f-4898-9e67-04ea44f62818 req-033712cd-c406-420e-bd8e-b7e3a85b487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff510c5-0fac-44d2-8c03-adc9c7952b43", "name": "network-vif-plugged", "status": "completed", "tag": "1b3eda2f-f745-4c51-9123-729b8664a84d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:33.522537 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:33.525371 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7b173cbd-5a1f-4898-9e67-04ea44f62818 req-033712cd-c406-420e-bd8e-b7e3a85b487c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:33.525959 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-7b173cbd-5a1f-4898-9e67-04ea44f62818 req-033712cd-c406-420e-bd8e-b7e3a85b487c service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:33.538931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-7b173cbd-5a1f-4898-9e67-04ea44f62818 req-033712cd-c406-420e-bd8e-b7e3a85b487c service nova] Creating event network-vif-plugged:1b3eda2f-f745-4c51-9123-729b8664a84d for instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 on hv-cinder-83124 Jun 21 18:35:33.544804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-7b173cbd-5a1f-4898-9e67-04ea44f62818 req-033712cd-c406-420e-bd8e-b7e3a85b487c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045770 Jun 21 18:35:33.550769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 462/934] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:34.355477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:34.356145 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:34.362959 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:34.363416 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:34.364794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:34.365431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:34.515498 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:34.523941 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e8995058-c25c-40b0-a172-08e030fbab3f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.172330 Jun 21 18:35:34.524579 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 473/935] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:34 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:35.539104 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=12 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:35.545486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:35.546274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:35.555321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:35.555895 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:35.556845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:35.557360 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:35.706856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:35.715454 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-be2c91b5-41ce-4c76-8910-fbf5a67f90a8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.177236 Jun 21 18:35:35.716056 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 463/936] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:35 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:36.733557 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:36.734207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:36.741560 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:36.742019 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:36.742809 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:36.743282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:36.898564 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:36.907273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-767c8a36-f06d-4f94-81e3-571454d97d4e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.178448 Jun 21 18:35:36.907960 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 474/937] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:36 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:37.924715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:37.925382 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:37.933496 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:37.933943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:37.934754 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:37.935188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:38.086669 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:38.095615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-909fbeec-735a-4235-826f-4d1aeda878ce tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1363 microversion: 2.1 time: 0.174836 Jun 21 18:35:38.096201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 464/938] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:37 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:39.120556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:39.121166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:39.128695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.133067 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.133067 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.133067 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.290691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:39.300118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d65c9971-2cb8-4220-9d86-4a780b684eb3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1550 microversion: 2.1 time: 0.183683 Jun 21 18:35:39.300978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 475/939] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:39 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1550 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:39.320094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:39.320766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:39.328267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.328903 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.329779 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.330279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.432626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e54bf9c8-bff3-40c1-b606-d0397b77f67c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113344 Jun 21 18:35:39.432626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 465/940] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:35:39 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:40.866934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-bf92b8c4-d17e-49c6-8ed0-6f6e86da2a7d req-8c6051ce-8743-4178-8d5e-25ccd33f2124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff510c5-0fac-44d2-8c03-adc9c7952b43", "tag": "1b3eda2f-f745-4c51-9123-729b8664a84d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:40.883495 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-bf92b8c4-d17e-49c6-8ed0-6f6e86da2a7d req-8c6051ce-8743-4178-8d5e-25ccd33f2124 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:40.884514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-bf92b8c4-d17e-49c6-8ed0-6f6e86da2a7d req-8c6051ce-8743-4178-8d5e-25ccd33f2124 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:40.916349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-bf92b8c4-d17e-49c6-8ed0-6f6e86da2a7d req-8c6051ce-8743-4178-8d5e-25ccd33f2124 service nova] Creating event network-changed:1b3eda2f-f745-4c51-9123-729b8664a84d for instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 on hv-cinder-83124 Jun 21 18:35:40.925738 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-bf92b8c4-d17e-49c6-8ed0-6f6e86da2a7d req-8c6051ce-8743-4178-8d5e-25ccd33f2124 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065527 Jun 21 18:35:40.927089 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 476/941] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:46.638387 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:46.639227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:46.645529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:46.645986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:46.646776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:46.647206 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:46.749157 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lazy-loading 'services' on Instance uuid d1023826-c337-4ae6-8a55-df1b85bcf610 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:35:46.988505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f27d454e-0189-4618-bbf9-76e01c44a1a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610/os-volume_attachments/ea5084d7-a643-4513-a64f-cdbdb2697022" status: 202 len: 0 microversion: 2.1 time: 0.354215 Jun 21 18:35:46.990505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 466/942] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:35:46 2022] DELETE /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610/os-volume_attachments/ea5084d7-a643-4513-a64f-cdbdb2697022 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:35:48.168142 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:48.169088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:48.181170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.181689 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.182538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.184173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.236259 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:35:48.629424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:48.630935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:48.634764 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:48.638892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.639391 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.640168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.640766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.647347 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:48.672011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:35:48.708648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3736f7f5-4db5-424a-81e4-ae7c2b5da04a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 204 len: 0 microversion: 2.1 time: 0.547637 Jun 21 18:35:48.714278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 477/943] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:35:48 2022] DELETE /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:35:48.721623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-fcf4348a-7b9c-4371-bcd2-eea8e11edb7e req-e1a80093-2bbf-4e44-9b6d-a83a35c453cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:48.732284 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-fcf4348a-7b9c-4371-bcd2-eea8e11edb7e req-e1a80093-2bbf-4e44-9b6d-a83a35c453cc service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.732903 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-fcf4348a-7b9c-4371-bcd2-eea8e11edb7e req-e1a80093-2bbf-4e44-9b6d-a83a35c453cc service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.746555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-fcf4348a-7b9c-4371-bcd2-eea8e11edb7e req-e1a80093-2bbf-4e44-9b6d-a83a35c453cc service nova] Creating event network-changed:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:35:48.753304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-fcf4348a-7b9c-4371-bcd2-eea8e11edb7e req-e1a80093-2bbf-4e44-9b6d-a83a35c453cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Jun 21 18:35:48.754203 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 478/944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:48.761755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:48.762536 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:48.770575 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.771180 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.772366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:48.772924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.939624 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:48.951064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0aa47080-3133-450c-aafb-b6f36699f7d7 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1514 microversion: 2.1 time: 0.194469 Jun 21 18:35:48.951892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 479/945] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:48 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:48.992147 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-020907f5-3284-4499-9cae-da4cd3e98ef8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "DELETE /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 204 len: 0 microversion: 2.1 time: 0.370464 Jun 21 18:35:48.992768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 467/946] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:35:48 2022] DELETE /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:35:49.001785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:49.002559 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:49.010540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.011260 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.012194 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.012770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.213370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:49.222282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:49.245485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4f22586c-7465-4bef-a645-e44882383b81 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.246263 Jun 21 18:35:49.255572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 480/947] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:48 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:49.979543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:49.980443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:49.988381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.997051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.997051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.997051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.180067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:50.188444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f5c0785d-0b95-489b-b63f-240adca9789b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1514 microversion: 2.1 time: 0.213154 Jun 21 18:35:50.189081 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 468/948] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:49 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:50.266205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:50.266840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:50.270679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:50.277078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:50.286282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.286282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:50.286282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.468160 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:50.477878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-046601f2-dc8e-4529-898d-3c1f18f6c8b8 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.216181 Jun 21 18:35:50.478643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 481/949] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:50 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:51.207226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:51.209101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:51.215101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.215542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:51.216383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.216830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:51.484067 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:51.493938 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0e05ac50-af1b-45b4-9482-77127c947800 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1514 microversion: 2.1 time: 0.290733 Jun 21 18:35:51.505879 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 469/950] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:51 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:51.506239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:51.506239 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:51.517112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.517649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:51.518939 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.519422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:51.777838 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:51.786888 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c1a7d824-793e-4200-aeef-b62dcfbdfa59 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1571 microversion: 2.1 time: 0.293047 Jun 21 18:35:51.787825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 482/951] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:51 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1571 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:52.203564 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-73c5f7cf-124e-4656-a6ce-7ba04eb11df0 req-8c5963c9-b0a4-4f28-8971-e9d4418cf8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1023826-c337-4ae6-8a55-df1b85bcf610", "name": "network-vif-deleted", "tag": "13ac0674-9166-43e7-b5fa-da5864ee9141"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:52.213039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-73c5f7cf-124e-4656-a6ce-7ba04eb11df0 req-8c5963c9-b0a4-4f28-8971-e9d4418cf8bd service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.213653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-73c5f7cf-124e-4656-a6ce-7ba04eb11df0 req-8c5963c9-b0a4-4f28-8971-e9d4418cf8bd service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.225539 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-73c5f7cf-124e-4656-a6ce-7ba04eb11df0 req-8c5963c9-b0a4-4f28-8971-e9d4418cf8bd service nova] Creating event network-vif-deleted:13ac0674-9166-43e7-b5fa-da5864ee9141 for instance d1023826-c337-4ae6-8a55-df1b85bcf610 on hv-cinder-83124 Jun 21 18:35:52.230845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-73c5f7cf-124e-4656-a6ce-7ba04eb11df0 req-8c5963c9-b0a4-4f28-8971-e9d4418cf8bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 Jun 21 18:35:52.231442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 470/952] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:52.522643 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:52.523287 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:52.530442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.531009 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.531969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.532567 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.576848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.576848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.576848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lazy-loading 'fault' on Instance uuid d1023826-c337-4ae6-8a55-df1b85bcf610 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:35:52.627358 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:52.639633 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7d5e57c1-5435-42a4-97b8-eaa5cc91cba1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 200 len: 1309 microversion: 2.1 time: 0.120840 Jun 21 18:35:52.641129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 483/953] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:52 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:52.809480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:52.810085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:52.818079 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.818710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.819590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:52.820035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.901240 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:52.911414 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b9fe7976-55f0-440c-b48b-a62c02c48a49 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1220 microversion: 2.1 time: 0.106402 Jun 21 18:35:52.912148 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 471/954] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:52 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:53.658884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:53.659506 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: d1023826-c337-4ae6-8a55-df1b85bcf610] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:53.671196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.671196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.671196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.671196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.685447 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] HTTP exception thrown: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Request method failure captured: Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 HTTP/1.1 Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg9GdF1GApE9R7kd2CMj3w63ED-KWM_8AlTxcYbEafRjkEGbtYalNDtXYJg1-_QZ4ayxuCgocPez_opEeqTDPFdAbUCQm_1f2cUfO4R1_gaVH0yQPUcmDFjtcIypeJikx9zIFTSzhGsaplfEYifOvt04WCs0JDXYSWD3q2vKLUfQLYE Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 20016956d3e2409cb41b02f7f0617daa Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:35:53.687253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 20016956d3e2409cb41b02f7f0617daa Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesSnapshotTestJSON-116169303-project Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 78a853ef1e51411e88ec7984693be865 Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesSnapshotTestJSON-116169303-project Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. Jun 21 18:35:53.689008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'd1023826-c337-4ae6-8a55-df1b85bcf610'} Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:53.689853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. Jun 21 18:35:53.691265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:35:53.694835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Returning 404 to user: Instance d1023826-c337-4ae6-8a55-df1b85bcf610 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:53.694835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-391b82dd-cabe-406a-aa8d-f22e37e16274 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610" status: 404 len: 111 microversion: 2.1 time: 0.034129 Jun 21 18:35:53.694835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 484/955] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:53 2022] GET /compute/v2.1/servers/d1023826-c337-4ae6-8a55-df1b85bcf610 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:35:53.929682 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:53.930783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:53.945988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.946453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.947227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.947663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.985195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.985646 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.986097 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lazy-loading 'fault' on Instance uuid 48bcd7e7-55e0-4321-a994-c987c07f341c {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:35:54.029427 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b17a680c640f19b0f402f371c6cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efebfec3f0401190b3116e52d634e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:54.042248 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0d97afd4-8acf-4233-9f5d-d0878fe7fbe5 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 200 len: 1225 microversion: 2.1 time: 0.116466 Jun 21 18:35:54.042833 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 472/956] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:53 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:54.267541 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-0ec4edd6-72d8-41de-908a-952848488376 req-02f55907-ee29-418f-b13f-bb4fe9de4d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bcd7e7-55e0-4321-a994-c987c07f341c", "name": "network-vif-deleted", "tag": "84a5bdbc-1f90-4da2-9138-4cc745833338"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:54.277262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-0ec4edd6-72d8-41de-908a-952848488376 req-02f55907-ee29-418f-b13f-bb4fe9de4d69 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:54.277715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-0ec4edd6-72d8-41de-908a-952848488376 req-02f55907-ee29-418f-b13f-bb4fe9de4d69 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:54.293935 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-0ec4edd6-72d8-41de-908a-952848488376 req-02f55907-ee29-418f-b13f-bb4fe9de4d69 service nova] Creating event network-vif-deleted:84a5bdbc-1f90-4da2-9138-4cc745833338 for instance 48bcd7e7-55e0-4321-a994-c987c07f341c on hv-cinder-83124 Jun 21 18:35:54.298921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-0ec4edd6-72d8-41de-908a-952848488376 req-02f55907-ee29-418f-b13f-bb4fe9de4d69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Jun 21 18:35:54.299521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 485/957] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:35:55.063045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:55.063687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] [instance: 48bcd7e7-55e0-4321-a994-c987c07f341c] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:55.071027 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:55.071479 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:55.072254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:55.072730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:55.087861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] HTTP exception thrown: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Request method failure captured: Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c HTTP/1.1 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg4-swzITWvXLNw7BpBxkTsXOSFCEwUhfcW8zpRXEJ39XMY8L8Uwn5YG_FTFZrGaUMtKuCTr3DwOXgXG8giTHeNYM6VOEd0OvCFcamDSOHtVgGNiZvC60dELCQzr_n_hjaBiT1gMAvvE17q6dQw7nKGFE1YE67QVHIZwApbjYI0Xvng Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 65efebfec3f0401190b3116e52d634e8 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestShelveInstance-618810001 Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:35:55.089574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65efebfec3f0401190b3116e52d634e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65efebfec3f0401190b3116e52d634e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65efebfec3f0401190b3116e52d634e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65efebfec3f0401190b3116e52d634e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestShelveInstance-618810001 Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 65efebfec3f0401190b3116e52d634e8 Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestShelveInstance-618810001 Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-TestShelveInstance-618810001-project Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 113b17a680c640f19b0f402f371c6cbb Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestShelveInstance-618810001-project Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. Jun 21 18:35:55.091234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '48bcd7e7-55e0-4321-a994-c987c07f341c'} Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:55.092149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. Jun 21 18:35:55.093501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:35:55.094661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Returning 404 to user: Instance 48bcd7e7-55e0-4321-a994-c987c07f341c could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:55.094661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8224bf58-4a25-4de7-855f-9459ddac8ae3 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c" status: 404 len: 111 microversion: 2.1 time: 0.031918 Jun 21 18:35:55.094661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 473/958] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:55 2022] GET /compute/v2.1/servers/48bcd7e7-55e0-4321-a994-c987c07f341c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:35:55.365714 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-414e81e7-5b1b-47e5-ba27-5459dc532450 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] Calling method '.version_select at 0x7fd39770f940>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:55.462289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-414e81e7-5b1b-47e5-ba27-5459dc532450 tempest-TestShelveInstance-618810001 tempest-TestShelveInstance-618810001-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1496082875" status: 202 len: 0 microversion: 2.1 time: 0.103033 Jun 21 18:35:55.462884 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 486/959] 10.222.0.23 () {58 vars in 1253 bytes} [Tue Jun 21 18:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1496082875 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:36:02.767565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-194639801", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "networks": [{"uuid": "071eec2e-b697-449b-8df0-f3b475d6a75d"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:02.870132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] validate_networks() for [('071eec2e-b697-449b-8df0-f3b475d6a75d', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:36:03.561167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:36:03.561634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:36:03.562464 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:36:03.563711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:36:03.563711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:36:03.575568 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.576122 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.577047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.577621 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.609773 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Getting quotas for project 20016956d3e2409cb41b02f7f0617daa. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:36:03.619472 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Getting quotas for user 78a853ef1e51411e88ec7984693be865 and project 20016956d3e2409cb41b02f7f0617daa. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:36:03.666084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:36:03.669439 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:36:03.837149 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-318db466-92aa-4290-bd2a-09286134b498 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078221 Jun 21 18:36:03.839753 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 474/960] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:36:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:36:03.861742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6636f06f-0939-4b8b-9a57-e21cc9627564 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:03.873611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6636f06f-0939-4b8b-9a57-e21cc9627564 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:03.971656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-6636f06f-0939-4b8b-9a57-e21cc9627564 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:03.988974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6636f06f-0939-4b8b-9a57-e21cc9627564 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1218 microversion: 2.1 time: 0.141913 Jun 21 18:36:03.990634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 487/961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:03 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:05.012714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b838d013-d935-4a63-a70b-ea261464f531 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:05.013815 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b838d013-d935-4a63-a70b-ea261464f531 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:05.123005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b838d013-d935-4a63-a70b-ea261464f531 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:05.134100 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b838d013-d935-4a63-a70b-ea261464f531 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1218 microversion: 2.1 time: 0.130474 Jun 21 18:36:05.135022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 475/962] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:05 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:06.154201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:06.154815 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:06.156806 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=25 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:06.162681 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.163136 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.163913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.164350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.232707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:06.241302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e721cd67-2d96-4532-8634-2a427df6e8a6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1214 microversion: 2.1 time: 0.091127 Jun 21 18:36:06.241891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 488/963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:06 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:07.268349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:07.270745 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:07.278038 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:07.278782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:07.279707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:07.280234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:07.386361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:07.395006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e1141db0-857f-472b-90ff-f670d5e5ce48 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1278 microversion: 2.1 time: 0.130479 Jun 21 18:36:07.405283 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 476/964] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:07 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:08.416756 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:08.417818 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:08.427379 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:08.428049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:08.429001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:08.429753 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:08.628800 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:08.643532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-aafb8b2b-1bd5-44ed-8c55-a5b593ce46d4 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.233545 Jun 21 18:36:08.645539 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 489/965] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:08 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:09.490874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-d0a1ba36-d880-46a3-959b-e589d2388c51 req-79a9b300-4694-4c71-973d-d2671c7419d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae", "tag": "0db8cbf5-15dc-4024-8145-a8bef0dccbd0"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:09.508177 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d0a1ba36-d880-46a3-959b-e589d2388c51 req-79a9b300-4694-4c71-973d-d2671c7419d7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:09.510388 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d0a1ba36-d880-46a3-959b-e589d2388c51 req-79a9b300-4694-4c71-973d-d2671c7419d7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:09.531557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-d0a1ba36-d880-46a3-959b-e589d2388c51 req-79a9b300-4694-4c71-973d-d2671c7419d7 service nova] Creating event network-changed:0db8cbf5-15dc-4024-8145-a8bef0dccbd0 for instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae on hv-cinder-83124 Jun 21 18:36:09.540991 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-d0a1ba36-d880-46a3-959b-e589d2388c51 req-79a9b300-4694-4c71-973d-d2671c7419d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056803 Jun 21 18:36:09.542830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 477/966] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:09.668260 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:09.669009 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:09.676510 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:09.677726 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:09.679576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:09.680944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:09.824412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:09.837820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5c1cc631-5580-4a22-9e62-d50b5b815278 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.173848 Jun 21 18:36:09.838596 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 490/967] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:09 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:10.857677 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:10.859561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:10.868500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:10.868985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:10.869821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:10.870257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:11.053918 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:11.063051 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0b95d141-60ac-4dad-8816-d2f4866b5f0b tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.211015 Jun 21 18:36:11.063637 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 478/968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:10 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:12.080797 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:12.081469 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:12.088622 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.089078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:12.090309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.090309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:12.241042 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:12.249702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-96400e25-4c9e-4692-9cc0-0162aeb5b461 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.172718 Jun 21 18:36:12.250300 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 491/969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:12 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:12.530715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-29750599", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:12.590613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] validate_networks() for None {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:36:12.895233 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:36:12.895652 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:36:12.896736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:36:12.897279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:36:12.897717 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:36:12.908810 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.909420 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:12.910593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.911242 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:12.931915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Getting quotas for project 090fe72cdd1a486f9da51253e153c45a. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:36:12.936384 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Getting quotas for user cdac600e644741ce83b25e684d1ea6d8 and project 090fe72cdd1a486f9da51253e153c45a. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:36:12.949691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:36:12.951968 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:36:13.101144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cd9193db-92ae-4d18-b63e-2ce787907049 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574124 Jun 21 18:36:13.101707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 479/970] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:36:13.112050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-08196212-cbd4-403f-8947-85b9825ff99c tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:13.113026 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-08196212-cbd4-403f-8947-85b9825ff99c tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:13.177012 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-08196212-cbd4-403f-8947-85b9825ff99c tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:13.190492 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-08196212-cbd4-403f-8947-85b9825ff99c tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1213 microversion: 2.1 time: 0.082406 Jun 21 18:36:13.191285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 492/971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:13 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:13.271886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:13.273058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:13.283794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:13.284250 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:13.285138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:13.285576 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:13.462297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:13.470489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-c9bb82d7-4ba5-4ecc-a862-cb3004e14d87 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.206616 Jun 21 18:36:13.471076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 480/972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:13 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:14.210763 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:14.211496 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:14.222392 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.223080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.224045 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.224924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.299734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:14.308654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a4c05ef1-3374-4dbf-8580-62309589d079 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1217 microversion: 2.1 time: 0.103215 Jun 21 18:36:14.309265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 493/973] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:14 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:14.488118 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:14.488752 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:14.496727 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.497255 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.498048 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.498488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.667173 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:14.676491 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d3d9da19-33b9-468c-b6f1-e3ffe02bcc66 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.192107 Jun 21 18:36:14.677085 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 481/974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:14 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:15.327428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:15.328033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:15.335050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.336050 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.336337 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.336803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.438922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:15.455099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b51df6ae-7863-4341-8909-86d1533ab5e0 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1273 microversion: 2.1 time: 0.130751 Jun 21 18:36:15.456789 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 494/975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:15 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:15.695580 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:15.696483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:15.703552 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.704000 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.704825 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.705256 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.944482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:15.958952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4a74bef3-78bd-4d5c-89fc-fdad00491de6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.261826 Jun 21 18:36:15.958952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 482/976] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:15 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:16.476140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:16.476749 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:16.483613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.484070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:16.484967 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.485415 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:16.556423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:16.569550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7be9dd7e-ae56-4791-ac1a-880d553fbfe7 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1271 microversion: 2.1 time: 0.097318 Jun 21 18:36:16.570667 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 495/977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:16 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:16.977661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:16.978954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:16.993049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.993891 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:16.995659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.996732 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.312346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:17.320729 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-acb97073-f76a-4f5a-bc4b-3b413034f771 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.350870 Jun 21 18:36:17.321350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 483/978] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:16 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:17.329030 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:17.329535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:17.336451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:17.336908 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.337736 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:17.338179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.365491 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b7b1ed86-9556-41fe-89d1-d3ffa4d45628 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/ips" status: 200 len: 147 microversion: 2.1 time: 0.040249 Jun 21 18:36:17.371115 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 496/979] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:36:17 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:17.598829 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:17.600602 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:17.610425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:17.611289 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.613027 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:17.613853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.716001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-958e6f29-5e83-41f0-b815-0d24540c070b req-8e098ddf-8d8f-405a-87ce-93d0e0e83976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae", "name": "network-vif-plugged", "status": "completed", "tag": "0db8cbf5-15dc-4024-8145-a8bef0dccbd0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:17.738125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-958e6f29-5e83-41f0-b815-0d24540c070b req-8e098ddf-8d8f-405a-87ce-93d0e0e83976 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:17.739093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-958e6f29-5e83-41f0-b815-0d24540c070b req-8e098ddf-8d8f-405a-87ce-93d0e0e83976 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:17.754547 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-958e6f29-5e83-41f0-b815-0d24540c070b req-8e098ddf-8d8f-405a-87ce-93d0e0e83976 service nova] Creating event network-vif-plugged:0db8cbf5-15dc-4024-8145-a8bef0dccbd0 for instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae on hv-cinder-83124 Jun 21 18:36:17.760865 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-958e6f29-5e83-41f0-b815-0d24540c070b req-8e098ddf-8d8f-405a-87ce-93d0e0e83976 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062270 Jun 21 18:36:17.761826 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 497/980] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:17.963910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:17.991842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2783d0b6-f33f-4da1-bd45-48415b0bc459 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.397404 Jun 21 18:36:17.992963 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 484/981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:17 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:18.180733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-fed35950-a25f-4211-89cd-d4471e6d566d req-87933de0-e563-4cf3-ae72-71dc7b50f203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5f1526-767c-40b1-84d5-d2e34d42ffe0", "tag": "2957c84e-8059-4511-952a-229c5b33a91d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:18.189989 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-fed35950-a25f-4211-89cd-d4471e6d566d req-87933de0-e563-4cf3-ae72-71dc7b50f203 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.197777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-fed35950-a25f-4211-89cd-d4471e6d566d req-87933de0-e563-4cf3-ae72-71dc7b50f203 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.202571 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-fed35950-a25f-4211-89cd-d4471e6d566d req-87933de0-e563-4cf3-ae72-71dc7b50f203 service nova] Creating event network-changed:2957c84e-8059-4511-952a-229c5b33a91d for instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 on hv-cinder-83124 Jun 21 18:36:18.207680 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-fed35950-a25f-4211-89cd-d4471e6d566d req-87933de0-e563-4cf3-ae72-71dc7b50f203 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031111 Jun 21 18:36:18.208891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 498/982] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:18.346101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:18.346101 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:18.352143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.352632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.353411 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.353843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.534613 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:18.549682 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fd8398b6-777e-4b32-89cf-96f9204e8459 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.211390 Jun 21 18:36:18.550587 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 485/983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:18 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:19.011904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:19.012719 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:19.019550 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.019997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.020821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.021558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.167178 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:19.175412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0cf1446d-83a2-438c-8540-380b97783a79 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.168424 Jun 21 18:36:19.175995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 499/984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:19 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:19.569404 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:19.570015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:19.572782 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:19.577899 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.578349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.579132 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.579763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.582808 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:19.798236 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:19.807722 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-66e6f7be-d5f4-4879-a7c5-3c4dd339e925 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1318 microversion: 2.1 time: 0.243026 Jun 21 18:36:19.808578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 486/985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:19 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:20.193841 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:20.194948 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:20.203549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.204154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.205110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.205646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.349808 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:20.356523 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a10b4947-b243-48b1-92fd-354973126f27 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.167843 Jun 21 18:36:20.357105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 500/986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:20 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:20.826179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:20.826740 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:20.834795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.835270 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.836083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.836532 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.982097 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb824a01-21c4-4bb7-8109-c93e9f9abb35"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:20.983411 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:20.990848 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.991385 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.996255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.996255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.007786 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:21.015530 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-cad9ad27-b62f-4264-aad7-45a6444c9335 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1507 microversion: 2.1 time: 0.193893 Jun 21 18:36:21.016116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 487/987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:20 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:21.033741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96457a76-6a21-48aa-901e-5f2a4adec723", "device": "/dev/sdb"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:21.035572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:21.042875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.043618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.044412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.044849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.733237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-faadd5c7-ba2c-4e12-90ef-beca696aa0b6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756246 Jun 21 18:36:21.733988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 501/988] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:36:20 2022] POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:21.739422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:21.741009 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:21.744949 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:21.748844 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.749299 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.750091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.750584 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.814487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ef9b93f2-e4a9-4426-b5b2-6e2cff561b8f tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "POST /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784796 Jun 21 18:36:21.815572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 488/989] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:36:21 2022] POST /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:21.927983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:21.942729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9808d469-15b5-4f4f-835a-ff477cd0c5f4 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.207000 Jun 21 18:36:21.945324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 502/990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:21 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:22.960075 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:22.960875 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=14 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:22.965041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:22.965766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:22.972254 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.977190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:22.977190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.977190 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.121093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:23.129045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-59fd08d9-d323-4cb0-b481-b34f91b2f114 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.170886 Jun 21 18:36:23.129634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:22 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:24.147646 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:24.148275 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:24.150715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:24.155720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.156166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.156972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.157410 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.293656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:24.301489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fa936373-0729-430b-9ece-a97de71b458b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.158249 Jun 21 18:36:24.302125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 503/992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:24 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:25.319305 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:25.319995 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:25.326712 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:25.327159 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:25.327932 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:25.328363 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:25.475490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:25.484822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a1cd8de1-d74d-4b07-99a4-556993d3fbba tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.169476 Jun 21 18:36:25.485397 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 490/993] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:25 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:25.708843 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-f291a8cf-39ec-4ca5-a7fe-6b298a5658e8 req-f523491e-b565-4076-b307-280001016432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5f1526-767c-40b1-84d5-d2e34d42ffe0", "name": "network-vif-plugged", "status": "completed", "tag": "2957c84e-8059-4511-952a-229c5b33a91d"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:25.717946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f291a8cf-39ec-4ca5-a7fe-6b298a5658e8 req-f523491e-b565-4076-b307-280001016432 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:25.718390 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-f291a8cf-39ec-4ca5-a7fe-6b298a5658e8 req-f523491e-b565-4076-b307-280001016432 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:25.730518 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-f291a8cf-39ec-4ca5-a7fe-6b298a5658e8 req-f523491e-b565-4076-b307-280001016432 service nova] Creating event network-vif-plugged:2957c84e-8059-4511-952a-229c5b33a91d for instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 on hv-cinder-83124 Jun 21 18:36:25.737438 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-f291a8cf-39ec-4ca5-a7fe-6b298a5658e8 req-f523491e-b565-4076-b307-280001016432 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Jun 21 18:36:25.738031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 504/994] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:26.502222 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:26.502876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:26.510495 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:26.510957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:26.511739 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:26.512178 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:26.649312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:26.656783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1fcf4d83-360e-4fef-8f74-35045be7095a tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1313 microversion: 2.1 time: 0.158436 Jun 21 18:36:26.657342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 491/995] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:26 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:27.675750 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:27.676458 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:27.683187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.683640 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.684445 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.684885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.826737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:27.834992 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-476b5c9d-9b2d-4cf3-a894-c9c13748ccfa tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1462 microversion: 2.1 time: 0.163948 Jun 21 18:36:27.835592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 505/996] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:27 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:27.876112 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:27.876790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:27.884350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.884870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.885648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.886096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.911297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:36:28.214165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-12287403-f29e-42fc-b219-6e5b33d636f1 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 204 len: 0 microversion: 2.1 time: 0.341565 Jun 21 18:36:28.214950 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 492/997] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:36:27 2022] DELETE /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:36:28.223185 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:28.225432 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:28.233278 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.233761 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.234549 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.234982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.257108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:28.409118 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:28.419635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-92d07662-4767-4b7b-9feb-e581373969ae tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1468 microversion: 2.1 time: 0.200311 Jun 21 18:36:28.420220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 506/998] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:28 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1468 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:29.438818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:29.440562 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:29.446471 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:29.446946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:29.447780 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:29.448218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:29.589698 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:29.597647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-dab63200-a922-488d-bca9-93ad367422c5 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1468 microversion: 2.1 time: 0.163303 Jun 21 18:36:29.598227 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 493/999] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:29 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:30.329551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-527fb4f4-5032-4d7f-9362-196052910404 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:30.337039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-527fb4f4-5032-4d7f-9362-196052910404 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.342931 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-527fb4f4-5032-4d7f-9362-196052910404 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.413394 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-527fb4f4-5032-4d7f-9362-196052910404 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Going to try to stop instance {{(pid=118474) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 18:36:30.468165 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-869ee80f-31c4-40e3-887f-6d0c4b1618e5 req-13b6eb4f-b3ed-4f5f-8202-76d65f166283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5f1526-767c-40b1-84d5-d2e34d42ffe0", "name": "network-vif-deleted", "tag": "2957c84e-8059-4511-952a-229c5b33a91d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:30.477374 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-869ee80f-31c4-40e3-887f-6d0c4b1618e5 req-13b6eb4f-b3ed-4f5f-8202-76d65f166283 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.477821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-869ee80f-31c4-40e3-887f-6d0c4b1618e5 req-13b6eb4f-b3ed-4f5f-8202-76d65f166283 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.492263 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-869ee80f-31c4-40e3-887f-6d0c4b1618e5 req-13b6eb4f-b3ed-4f5f-8202-76d65f166283 service nova] Creating event network-vif-deleted:2957c84e-8059-4511-952a-229c5b33a91d for instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 on hv-cinder-83124 Jun 21 18:36:30.497569 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-869ee80f-31c4-40e3-887f-6d0c4b1618e5 req-13b6eb4f-b3ed-4f5f-8202-76d65f166283 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Jun 21 18:36:30.498459 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 494/1000] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:30.616361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:30.617195 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:30.624133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.624625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.625416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.625862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.657254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-527fb4f4-5032-4d7f-9362-196052910404 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action" status: 202 len: 0 microversion: 2.1 time: 0.331469 Jun 21 18:36:30.657883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 507/1001] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:30 2022] POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:30.668095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:30.669076 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:30.678056 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.679186 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.680210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.680701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.728381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:30.738541 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7e04b396-4a9a-4114-a6f5-3a20b07a8d8b tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1298 microversion: 2.1 time: 0.126608 Jun 21 18:36:30.739140 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 495/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:30 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:30.850210 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:30.862661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-13f2e9c3-4b32-4a98-ad59-0e4d58487468 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.200137 Jun 21 18:36:30.863262 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 508/1003] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:30 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:31.756302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:31.757143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:31.764191 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.764679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.765508 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.765906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.800300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.801141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.801255 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lazy-loading 'fault' on Instance uuid be5f1526-767c-40b1-84d5-d2e34d42ffe0 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:31.842473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac600e644741ce83b25e684d1ea6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090fe72cdd1a486f9da51253e153c45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:31.852520 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-548bee5c-df6b-4264-8f94-3a1cf8593eb8 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 200 len: 1303 microversion: 2.1 time: 0.099965 Jun 21 18:36:31.853140 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 496/1004] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:31 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:31.882208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:31.882775 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:31.889508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.889997 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.890761 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.891192 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.201574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:32.210554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7cc02c4c-b981-4397-8286-53bed31b2176 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.333286 Jun 21 18:36:32.211141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 509/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:31 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:32.875421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:32.876089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] [instance: be5f1526-767c-40b1-84d5-d2e34d42ffe0] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:32.883786 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:32.884238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.885056 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:32.885505 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.900369 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] HTTP exception thrown: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Request method failure captured: Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 HTTP/1.1 Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg-aGEvjzuicpylfEjyJLlAYvQIE7k-geSXq78NDpnDH_xT6sIF7sHw5vbidCJiMXR9qXuhuuGxsRFWwd5Eu9B4mrKljxHvNjiUC3u5yQ8_5v9ZnzsDLzaApFSBqxBJ89E1owPEm0uoG71EoF09vOhsuYp2_VDsSPCTs84GF4Mfr5hk Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 090fe72cdd1a486f9da51253e153c45a Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-VolumesNegativeTest-467688812 Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:36:32.902093 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/090fe72cdd1a486f9da51253e153c45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_090fe72cdd1a486f9da51253e153c45a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/090fe72cdd1a486f9da51253e153c45a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/090fe72cdd1a486f9da51253e153c45a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-VolumesNegativeTest-467688812 Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 090fe72cdd1a486f9da51253e153c45a Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-VolumesNegativeTest-467688812 Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-VolumesNegativeTest-467688812-project Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: cdac600e644741ce83b25e684d1ea6d8 Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-VolumesNegativeTest-467688812-project Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. Jun 21 18:36:32.903845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'be5f1526-767c-40b1-84d5-d2e34d42ffe0'} Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:32.904766 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. Jun 21 18:36:32.906444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:36:32.907958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] Returning 404 to user: Instance be5f1526-767c-40b1-84d5-d2e34d42ffe0 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:32.907958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fb8f77f9-948c-4919-aeb0-01d36b8e8391 tempest-VolumesNegativeTest-467688812 tempest-VolumesNegativeTest-467688812-project] 10.222.0.23 "GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0" status: 404 len: 111 microversion: 2.1 time: 0.032053 Jun 21 18:36:32.907958 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 497/1006] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:32 2022] GET /compute/v2.1/servers/be5f1526-767c-40b1-84d5-d2e34d42ffe0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:36:33.228218 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:33.228920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:33.235676 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:33.236122 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:33.236932 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:33.237365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:33.394683 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:33.403129 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7eb86eb5-21b7-49fb-a508-b6151ec16138 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.179092 Jun 21 18:36:33.403702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 510/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:33 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:34.422559 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:34.423245 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:34.430979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:34.432043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:34.432307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:34.432775 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:34.581803 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:34.591646 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-404f966a-ed4c-4e11-b147-f3c813287429 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.173186 Jun 21 18:36:34.592636 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 498/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:34 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:35.617896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:35.618853 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:35.631230 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:35.633613 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:35.634575 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:35.635108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:35.810805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:35.819975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f1d376d2-20a3-425c-8430-987c5048765e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.208523 Jun 21 18:36:35.820592 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 511/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:35 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:36.848346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:36.848346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:36.854945 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:36.855408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:36.856354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:36.856715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:37.013189 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:37.026162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5bc52aad-f89e-442b-a5e1-475668db9d0d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.183880 Jun 21 18:36:37.027108 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 499/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:36 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:38.044316 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:38.045091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:38.051381 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:38.051830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:38.052707 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:38.053177 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:38.201978 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:38.211428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-13ee6243-518f-4271-92b8-29565dde1af7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.171200 Jun 21 18:36:38.212037 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 512/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:38 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:39.231345 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:39.231966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:39.238947 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:39.239625 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:39.241359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:39.241800 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:39.435975 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:39.438458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:39.446241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8512f979-68c7-4562-b7bc-e6bbaa5ac2c0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.218802 Jun 21 18:36:39.446834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 500/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:39 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:40.463711 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:40.464324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:40.471357 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:40.471812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:40.472629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:40.473075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:40.608490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:40.616988 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fc407d23-bb1e-44b6-a4b4-3ed661176cc3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.157726 Jun 21 18:36:40.617574 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 513/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:40 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:41.636349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:41.637016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:41.644164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:41.644639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:41.645453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:41.645911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:41.794710 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:41.802789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-741ce341-d179-4d7b-accb-3d05ec709535 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.172161 Jun 21 18:36:41.803367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 501/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:41 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:42.833393 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:42.834183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:42.841741 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:42.847173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:42.847173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:42.847173 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:42.978529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:42.986533 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-3207ec47-ea07-4457-9497-b84bfe57bc7e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.157513 Jun 21 18:36:42.987094 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 514/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:42 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:44.004351 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:44.004982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:44.013416 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:44.013862 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:44.014629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:44.015058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:44.162853 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:44.171914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3ec67f61-0caf-479e-a44f-6abb4b77092a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.171665 Jun 21 18:36:44.172540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 502/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:43 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:45.191277 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:45.191921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:45.198956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.199442 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.200253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.200729 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.341535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:45.349847 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-8f41d60d-bb48-4fd4-aa97-330908daf3b0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.162492 Jun 21 18:36:45.350417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 515/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:45 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:46.366982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:46.367618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:46.375341 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.375787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.376614 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.377049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.534243 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:46.549748 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2ef0a482-e7e6-42e4-8a6c-218be5401320 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.186720 Jun 21 18:36:46.550346 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 503/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:46 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:47.567205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:47.567769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:47.575410 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:47.576778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:47.576778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:47.577093 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:47.708798 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:47.717315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-db6fbbad-5591-478b-a4c7-df127528b4a5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.154096 Jun 21 18:36:47.717878 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 516/1019] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:47 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:48.734061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:48.734790 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:48.741262 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:48.741711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:48.742957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:48.742957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:48.874769 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:48.884145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e6e27886-1b30-4e38-bc38-f3cc9a1150d3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.153877 Jun 21 18:36:48.884783 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 504/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:48 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:49.902170 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:49.902784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:49.909544 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:49.909991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:49.910745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:49.911175 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.046991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:50.055011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2281319b-c138-49d9-938e-2239b03ec01d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.157963 Jun 21 18:36:50.055604 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 517/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:49 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:50.571175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:50.572065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:50.578424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:50.578871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.579632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:50.580068 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.661062 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lazy-loading 'services' on Instance uuid e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:50.842632 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62bef942-4f17-49f9-9a61-01a3cc24ccd6 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae/os-volume_attachments/96457a76-6a21-48aa-901e-5f2a4adec723" status: 202 len: 0 microversion: 2.1 time: 0.275153 Jun 21 18:36:50.843142 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 505/1022] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:36:50 2022] DELETE /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae/os-volume_attachments/96457a76-6a21-48aa-901e-5f2a4adec723 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:51.073805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:51.074421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:51.081306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.081755 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.082534 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.083088 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.222309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:51.230865 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5e51a721-8054-4f99-986d-77037acf7522 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1725 microversion: 2.1 time: 0.161201 Jun 21 18:36:51.231431 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 518/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:51 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:51.957976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:51.958564 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:51.960593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:51.966849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.967307 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.968087 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.968563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.997828 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:36:52.248921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:52.249779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:52.253238 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=34 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:52.257279 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.257737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.258519 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.259600 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.345488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-62b05a38-43ab-4881-ba84-8130743c9b75 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 204 len: 0 microversion: 2.1 time: 0.391970 Jun 21 18:36:52.346094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 506/1024] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:36:51 2022] DELETE /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:36:52.355056 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:52.355720 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:52.362193 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.362656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.363423 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.363858 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.412410 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:52.421250 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e15589c0-fdcb-4c4a-a031-9509a4bee5f2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1702 microversion: 2.1 time: 0.176489 Jun 21 18:36:52.421830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 519/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:52 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1702 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:52.439075 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-91497262-5471-4b45-b26b-20e75d323d9e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:52.445282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-91497262-5471-4b45-b26b-20e75d323d9e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.445735 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-91497262-5471-4b45-b26b-20e75d323d9e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.470892 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-91497262-5471-4b45-b26b-20e75d323d9e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Going to try to start instance {{(pid=118474) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 18:36:52.516127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:52.523880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a1ca09f0-50fb-4b0c-a245-b563b75313b2 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1513 microversion: 2.1 time: 0.173314 Jun 21 18:36:52.524483 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 507/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:52 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:52.645701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-91497262-5471-4b45-b26b-20e75d323d9e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action" status: 202 len: 0 microversion: 2.1 time: 0.210312 Jun 21 18:36:52.646334 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 520/1027] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:52 2022] POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:36:52.655045 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:52.655653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:52.661633 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.666120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.666120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.666120 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.795197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:52.803593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-431c9114-7b51-468f-8a41-34cf19a255e4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1711 microversion: 2.1 time: 0.152389 Jun 21 18:36:52.804198 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 508/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:52 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:53.543215 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:53.543888 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:53.551220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.551675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.552501 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.552944 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.558338 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:53.696972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:53.705199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a5b7903c-28d0-462c-adca-d833767a01a1 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1513 microversion: 2.1 time: 0.167567 Jun 21 18:36:53.705777 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 521/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:53 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:53.822342 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:53.822905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:53.829438 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.829890 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.830655 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.831091 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.986615 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:53.996016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3a9fa1d2-c788-430c-9f08-7a08884b3747 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1711 microversion: 2.1 time: 0.177702 Jun 21 18:36:53.996622 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 509/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:53 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:54.723197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:54.723954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:54.731503 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:54.731995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:54.732975 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:54.733422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:54.878483 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:54.888326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4732231b-aa71-49b5-9cf4-0ad31bab1190 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1513 microversion: 2.1 time: 0.169051 Jun 21 18:36:54.888964 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 522/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:54 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:55.015114 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:55.015778 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:55.022831 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.023280 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.024279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.024826 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.063227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b19f060d-324d-4e34-92a5-f5133f34f7e7 req-d7a46d32-d953-4da1-8cc9-1b48fecaf077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae", "name": "network-vif-deleted", "tag": "0db8cbf5-15dc-4024-8145-a8bef0dccbd0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:55.078348 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b19f060d-324d-4e34-92a5-f5133f34f7e7 req-d7a46d32-d953-4da1-8cc9-1b48fecaf077 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.079502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b19f060d-324d-4e34-92a5-f5133f34f7e7 req-d7a46d32-d953-4da1-8cc9-1b48fecaf077 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.104016 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b19f060d-324d-4e34-92a5-f5133f34f7e7 req-d7a46d32-d953-4da1-8cc9-1b48fecaf077 service nova] Creating event network-vif-deleted:0db8cbf5-15dc-4024-8145-a8bef0dccbd0 for instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae on hv-cinder-83124 Jun 21 18:36:55.110523 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b19f060d-324d-4e34-92a5-f5133f34f7e7 req-d7a46d32-d953-4da1-8cc9-1b48fecaf077 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055059 Jun 21 18:36:55.111454 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 523/1032] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:55.186460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:55.196757 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-14a15eec-cd74-43bd-a9f6-32343279b231 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1711 microversion: 2.1 time: 0.185990 Jun 21 18:36:55.197425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 510/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:55 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:55.911172 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:55.911885 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:55.919636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.920095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.920920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.921366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.955583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.956041 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.956535 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lazy-loading 'fault' on Instance uuid e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:56.000302 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a853ef1e51411e88ec7984693be865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20016956d3e2409cb41b02f7f0617daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:56.008762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-103004df-9900-4389-8cdb-e8b55613a906 tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 200 len: 1308 microversion: 2.1 time: 0.102223 Jun 21 18:36:56.009520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 524/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:55 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:56.215168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:56.216063 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:56.225817 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:56.226396 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:56.227444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:56.229160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:56.366544 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:56.376273 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7bc6b07-a3af-483f-b389-862eed6919a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1711 microversion: 2.1 time: 0.165007 Jun 21 18:36:56.381496 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 511/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:56 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:57.027311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:57.027969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] [instance: e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:57.034889 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.035337 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.036133 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.036605 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.051457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] HTTP exception thrown: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Request method failure captured: Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae HTTP/1.1 Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg9GdF1GApE9R7kd2CMj3w63ED-KWM_8AlTxcYbEafRjkEGbtYalNDtXYJg1-_QZ4ayxuCgocPez_opEeqTDPFdAbUCQm_1f2cUfO4R1_gaVH0yQPUcmDFjtcIypeJikx9zIFTSzhGsaplfEYifOvt04WCs0JDXYSWD3q2vKLUfQLYE Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 20016956d3e2409cb41b02f7f0617daa Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:36:57.053183 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20016956d3e2409cb41b02f7f0617daa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 20016956d3e2409cb41b02f7f0617daa Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-116169303 Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-VolumesSnapshotTestJSON-116169303-project Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 78a853ef1e51411e88ec7984693be865 Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-VolumesSnapshotTestJSON-116169303-project Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. Jun 21 18:36:57.055973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae'} Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:57.057517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. Jun 21 18:36:57.060227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.062321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] Returning 404 to user: Instance e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:57.062321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-dab4ce50-f416-4c88-b9a2-0c03fcd4cf6a tempest-VolumesSnapshotTestJSON-116169303 tempest-VolumesSnapshotTestJSON-116169303-project] 10.222.0.23 "GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae" status: 404 len: 111 microversion: 2.1 time: 0.032090 Jun 21 18:36:57.062321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 525/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:57 2022] GET /compute/v2.1/servers/e70b0a98-48a3-4fbe-89ad-3ef44c4b20ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:36:57.395151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:57.395787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:57.402691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.403151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.403943 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.404421 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.568068 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:57.577360 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-49c73d95-4c33-4a69-a280-1958c54a529e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1715 microversion: 2.1 time: 0.186252 Jun 21 18:36:57.577954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 512/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:57 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1715 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:19.963720 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:37:19.964451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:37:29.989660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:29.990350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:29.992257 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=15 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:29.992916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=22 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:29.997829 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:29.998276 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:29.999046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:29.999479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:30.307078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lazy-loading 'services' on Instance uuid 3ff510c5-0fac-44d2-8c03-adc9c7952b43 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:37:30.550490 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-32f19b11-0864-455a-9ef8-6365aca2d3ec tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments/eb824a01-21c4-4bb7-8109-c93e9f9abb35" status: 202 len: 0 microversion: 2.1 time: 0.564782 Jun 21 18:37:30.551084 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 526/1038] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:37:29 2022] DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments/eb824a01-21c4-4bb7-8109-c93e9f9abb35 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:31.671543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9d611c5d-9d6c-438b-b6a0-60f09e1d515c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:31.674134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:31.674811 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:31.679842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9d611c5d-9d6c-438b-b6a0-60f09e1d515c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:31.680295 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9d611c5d-9d6c-438b-b6a0-60f09e1d515c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:31.743312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9d611c5d-9d6c-438b-b6a0-60f09e1d515c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Going to try to stop instance {{(pid=118472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 18:37:31.948510 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9d611c5d-9d6c-438b-b6a0-60f09e1d515c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action" status: 202 len: 0 microversion: 2.1 time: 0.280619 Jun 21 18:37:31.950381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 513/1039] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:37:31 2022] POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:31.966021 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:31.967308 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:31.977428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:31.977886 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:31.978677 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:31.979123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:32.117849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:32.126623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-296e50c3-92fd-46d2-a808-0bead2c7f396 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.169894 Jun 21 18:37:32.127202 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 527/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:31 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:33.146540 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:33.147164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:33.154735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.155184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.155954 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.156606 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.399379 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:33.407318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b924316f-e11c-4237-9d73-21cbd9a369c4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.265838 Jun 21 18:37:33.407907 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 514/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:33 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:34.425409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:34.426029 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:34.432090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:34.432576 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:34.433350 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:34.433787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:34.570155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:34.577597 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b986766a-b6c2-4ad7-981a-b88e0408a58e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.156277 Jun 21 18:37:34.578187 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 528/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:34 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:35.596096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:35.596693 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:35.603197 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.603651 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.604451 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.604898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.742298 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:35.750832 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d34852d2-09e1-4b7e-896f-f825f0daaa8d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.158765 Jun 21 18:37:35.751442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 515/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:35 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:36.769588 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:36.770311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:36.777276 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.777722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.779258 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.780251 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.924586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:36.932423 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b42d416d-1097-43a7-85b5-761695829003 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.166921 Jun 21 18:37:36.932995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 529/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:36 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:37.952061 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:37.955556 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:37.959576 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.960035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.961026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.961475 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:38.109036 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:38.116855 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f147e6eb-d27c-40b0-8d59-7b0db1be58b5 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.170154 Jun 21 18:37:38.117446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 516/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:37 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:39.136327 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:39.136981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:39.144328 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:39.144745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:39.145540 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:39.145966 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:39.287573 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:39.296099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-4516e20b-8d37-413d-a3cc-5026dfaaa155 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.164500 Jun 21 18:37:39.304648 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 530/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:39 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:40.313577 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:40.314234 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:40.320716 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.321172 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.321935 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.322364 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.464338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:40.473647 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-5406f0c7-1718-4077-b5dc-b3ecf2098aeb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.163879 Jun 21 18:37:40.474223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 517/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:40 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:41.491224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:41.491835 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:41.499142 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.499589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:41.500361 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.500834 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:41.629684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:41.637639 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-20a4e7ed-7a05-4b78-b100-2388d5730adb tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1679 microversion: 2.1 time: 0.150462 Jun 21 18:37:41.638822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 531/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:41 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:42.655985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:42.660458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:42.663376 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:42.663876 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:42.664699 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:42.665160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:42.799315 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:42.807860 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b90ca357-4bf9-46f3-973b-24c7fa21be9b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1656 microversion: 2.1 time: 0.156553 Jun 21 18:37:42.808454 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 518/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:42 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:42.824830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-6ba12ecf-2a5e-41e9-bdc0-ffb29aadd023 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:42.831532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ba12ecf-2a5e-41e9-bdc0-ffb29aadd023 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:42.831983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-6ba12ecf-2a5e-41e9-bdc0-ffb29aadd023 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:42.854814 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-6ba12ecf-2a5e-41e9-bdc0-ffb29aadd023 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Going to try to start instance {{(pid=118474) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 18:37:43.068981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-6ba12ecf-2a5e-41e9-bdc0-ffb29aadd023 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action" status: 202 len: 0 microversion: 2.1 time: 0.247759 Jun 21 18:37:43.069502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 532/1050] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Jun 21 18:37:42 2022] POST /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:43.077735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:43.078343 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:43.085593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.086039 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.086818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.087261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.232697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:43.242929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-0fda7dfd-c291-453f-8227-409b7c7137e3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1665 microversion: 2.1 time: 0.168818 Jun 21 18:37:43.243940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 519/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:43 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1665 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:44.263037 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:44.263744 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:44.270254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.270710 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.271486 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.271954 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.407194 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:44.415308 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a87e8e7a-c601-4f6d-9113-0f6edd83800a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1665 microversion: 2.1 time: 0.157104 Jun 21 18:37:44.415870 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 533/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:44 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:45.433671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:45.441981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:45.441981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:45.441981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:45.442707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:45.443179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:45.580924 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:45.589412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d752718d-3c0a-4ee9-9eb9-114a95df95b9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1669 microversion: 2.1 time: 0.160175 Jun 21 18:37:45.589982 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 520/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:45 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:17.622479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:17.623470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:17.625879 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=16 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:17.626649 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:17.631368 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.632078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.632882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.633324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.663601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9a4af473-cbed-49e9-9ce6-cee4529f92c3 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045800 Jun 21 18:38:17.664154 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 534/1054] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:17 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:38:17.723015 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:17.723670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:17.725887 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=16 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:17.726620 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:17.731767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.732210 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.733021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.733458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.760442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:38:18.234856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-920d4b95-28a1-4785-a759-49a0952c68f4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 204 len: 0 microversion: 2.1 time: 0.515375 Jun 21 18:38:18.235523 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 521/1055] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:38:17 2022] DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:38:18.243904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:18.244554 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:18.252235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.263890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.263890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.263890 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.424833 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:18.432634 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bac0087d-d915-4643-a0f6-96ee01c57651 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1675 microversion: 2.1 time: 0.192870 Jun 21 18:38:18.433253 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 535/1056] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:18 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:19.449789 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:19.450581 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:19.457627 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.458077 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.458952 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.459403 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.593648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:19.601850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aacd68fc-786c-4c1a-906a-fecd26f07ad7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1675 microversion: 2.1 time: 0.156325 Jun 21 18:38:19.602425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 522/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:19 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:20.620714 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:20.621274 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:20.629232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.629690 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:20.630470 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.630909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:20.776920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:20.784972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7e6027a3-5758-4e0e-a47f-6fa220158c6c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1675 microversion: 2.1 time: 0.168218 Jun 21 18:38:20.785555 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 536/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:20 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:21.298927 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-d13cfd24-a2b9-4c2c-95fb-ed4986714db6 req-f7a5890e-6a19-43d3-a9c1-4fdb149cf3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff510c5-0fac-44d2-8c03-adc9c7952b43", "name": "network-vif-deleted", "tag": "1b3eda2f-f745-4c51-9123-729b8664a84d"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:21.324065 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d13cfd24-a2b9-4c2c-95fb-ed4986714db6 req-f7a5890e-6a19-43d3-a9c1-4fdb149cf3b1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:21.324608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d13cfd24-a2b9-4c2c-95fb-ed4986714db6 req-f7a5890e-6a19-43d3-a9c1-4fdb149cf3b1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:21.338648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-d13cfd24-a2b9-4c2c-95fb-ed4986714db6 req-f7a5890e-6a19-43d3-a9c1-4fdb149cf3b1 service nova] Creating event network-vif-deleted:1b3eda2f-f745-4c51-9123-729b8664a84d for instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 on hv-cinder-83124 Jun 21 18:38:21.345408 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-d13cfd24-a2b9-4c2c-95fb-ed4986714db6 req-f7a5890e-6a19-43d3-a9c1-4fdb149cf3b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116733 Jun 21 18:38:21.346023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 523/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:21.808568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:21.809142 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:21.815986 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:21.816485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:21.817273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:21.817723 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:21.851924 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:21.852513 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:21.852872 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lazy-loading 'fault' on Instance uuid 3ff510c5-0fac-44d2-8c03-adc9c7952b43 {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:38:21.898366 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:21.907672 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-640edced-e34a-4b34-9280-e64aa9693983 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 200 len: 1327 microversion: 2.1 time: 0.103075 Jun 21 18:38:21.908242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 537/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:21 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:22.928261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:22.929109 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:22.935703 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:22.936154 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:22.936970 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:22.937419 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:22.952605 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 HTTP/1.1 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:38:22.954425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:38:22.956361 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '3ff510c5-0fac-44d2-8c03-adc9c7952b43'} Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:38:22.957601 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:38:22.959365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:38:22.960886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:38:22.960886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d30bb7b1-9885-4159-83d3-4a7a4ede2cb8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 404 len: 111 microversion: 2.1 time: 0.032704 Jun 21 18:38:22.960886 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 524/1061] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:22 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:38:22.965206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-62d9e9e3-456d-401f-b964-9611a21e128c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '.version_select at 0x7fd39c0709d0>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:23.070208 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-62d9e9e3-456d-401f-b964-9611a21e128c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702166396" status: 202 len: 0 microversion: 2.1 time: 0.109039 Jun 21 18:38:23.070778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 538/1062] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Jun 21 18:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702166396 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:23.979049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9a5a30d2-d2e2-4a53-a99e-14bab576bc3e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: .version_select at 0x7fd39c1ab430>, body: {"keypair": {"name": "tempest-keypair-1062812981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMw3wcC+SQijx0lcTyVAAirDbyB7IC9zvccYES3cjHbKSXUY0gHjW8oWG46veKkZbY4vatNIJlTyZun1yjNQXBj6rN7BWE+iPmOx5e4r3MKTZeA+OgJBz0F6WCmqCuMhQ=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:23.994131 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9a5a30d2-d2e2-4a53-a99e-14bab576bc3e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for project 466c7ed97ff34cd7824164207ab764d0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:23.997911 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-9a5a30d2-d2e2-4a53-a99e-14bab576bc3e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for user 5b424248bfb84fe4a25269232e08dcaf and project 466c7ed97ff34cd7824164207ab764d0. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:24.117925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9a5a30d2-d2e2-4a53-a99e-14bab576bc3e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142974 Jun 21 18:38:24.118476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 525/1063] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:38:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:26.846761 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1259209962", "imageRef": "92a19717-5d25-48bb-9c52-6de92514b4ae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5780ac4-4d57-4ab3-99d1-850208be45a3"}], "security_groups": [{"name": "tempest-securitygroup--1869073560"}], "key_name": "tempest-keypair-1062812981", "user_data": "}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:26.967196 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] validate_networks() for [('b5780ac4-4d57-4ab3-99d1-850208be45a3', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:38:27.354441 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:38:27.354864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:38:27.355336 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:38:27.355743 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:38:27.356151 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:38:27.367068 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:27.367521 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:27.368334 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:27.368810 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:27.386737 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for project 466c7ed97ff34cd7824164207ab764d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:27.391828 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Getting quotas for user 5b424248bfb84fe4a25269232e08dcaf and project 466c7ed97ff34cd7824164207ab764d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:27.403242 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:38:27.405544 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='92a19717-5d25-48bb-9c52-6de92514b4ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:38:27.587318 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-cd11f4f3-01a8-42a1-9df3-3f23691ea729 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746087 Jun 21 18:38:27.587880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 539/1064] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:38:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:38:27.604485 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-13e2dcdb-e215-4313-b3de-1ecc6b8a0520 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:27.605139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-13e2dcdb-e215-4313-b3de-1ecc6b8a0520 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:27.662639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-13e2dcdb-e215-4313-b3de-1ecc6b8a0520 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:27.669496 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-13e2dcdb-e215-4313-b3de-1ecc6b8a0520 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1238 microversion: 2.1 time: 0.069490 Jun 21 18:38:27.670060 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 526/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:27 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:38:28.688191 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7ae05ab1-176e-42ed-bef2-15df51da69dd tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:28.689952 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7ae05ab1-176e-42ed-bef2-15df51da69dd tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:28.749724 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7ae05ab1-176e-42ed-bef2-15df51da69dd tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:28.757653 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7ae05ab1-176e-42ed-bef2-15df51da69dd tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1238 microversion: 2.1 time: 0.074044 Jun 21 18:38:28.758157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 540/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:28 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:29.776136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-696c30e5-ce45-4348-9c79-5db3fadce000 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:29.776864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-696c30e5-ce45-4348-9c79-5db3fadce000 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:29.834824 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-696c30e5-ce45-4348-9c79-5db3fadce000 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:29.842008 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-696c30e5-ce45-4348-9c79-5db3fadce000 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1238 microversion: 2.1 time: 0.069832 Jun 21 18:38:29.842571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 527/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:29 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:30.862433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-67f7ea5f-f3dc-4ac9-a474-bce130c12cae tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:30.863033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-67f7ea5f-f3dc-4ac9-a474-bce130c12cae tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:30.915537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-67f7ea5f-f3dc-4ac9-a474-bce130c12cae tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:30.922338 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-67f7ea5f-f3dc-4ac9-a474-bce130c12cae tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1238 microversion: 2.1 time: 0.064722 Jun 21 18:38:30.923605 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 541/1068] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:30 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:31.940821 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:31.941433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:31.949223 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:31.949681 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:31.950474 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:31.950917 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:32.013547 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:32.023129 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4afa9f09-f5e9-4321-8b40-b7904ee6ac85 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1242 microversion: 2.1 time: 0.086740 Jun 21 18:38:32.023930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 528/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:31 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:33.040803 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:33.041767 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:33.049936 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:33.050421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:33.051224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:33.051698 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:33.121149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:33.129631 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7812449b-3bff-4747-b9ea-51348db82aa6 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1234 microversion: 2.1 time: 0.092854 Jun 21 18:38:33.130206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 542/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:33 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:34.147696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:34.148310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:34.155341 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:34.155871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:34.156687 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:34.157729 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:34.238869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:34.247481 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1d566884-420f-4d40-8c63-cec455addf32 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1296 microversion: 2.1 time: 0.102669 Jun 21 18:38:34.247481 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 529/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:34 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:35.265972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:35.266827 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:35.273429 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:35.273862 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:35.274640 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:35.275267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:35.422237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:35.432813 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-88e9b0e0-bc15-4995-9884-1b7b4ce3c6f8 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.172403 Jun 21 18:38:35.433414 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 543/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:35 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:35.789287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-5a75c3e8-6cb4-44ba-a167-f9a4ccd21661 req-bfbca067-6cf8-4d41-b21a-bfbd08498e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2daa55-5d35-445b-a992-935bedc24fca", "tag": "f8178e73-588f-44c9-a5b5-270e31761fe2"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:35.800339 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5a75c3e8-6cb4-44ba-a167-f9a4ccd21661 req-bfbca067-6cf8-4d41-b21a-bfbd08498e5b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:35.800931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-5a75c3e8-6cb4-44ba-a167-f9a4ccd21661 req-bfbca067-6cf8-4d41-b21a-bfbd08498e5b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:35.814414 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-5a75c3e8-6cb4-44ba-a167-f9a4ccd21661 req-bfbca067-6cf8-4d41-b21a-bfbd08498e5b service nova] Creating event network-changed:f8178e73-588f-44c9-a5b5-270e31761fe2 for instance 5e2daa55-5d35-445b-a992-935bedc24fca on hv-cinder-83124 Jun 21 18:38:35.820011 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-5a75c3e8-6cb4-44ba-a167-f9a4ccd21661 req-bfbca067-6cf8-4d41-b21a-bfbd08498e5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034545 Jun 21 18:38:35.820997 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 530/1073] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:36.457413 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:36.458156 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:36.464901 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:36.465356 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:36.466140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:36.466583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:36.605422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:36.614110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b67bb57b-7d2c-4b55-9841-17665fb87cc4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.160687 Jun 21 18:38:36.614685 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 544/1074] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:36 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:37.633304 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:37.633930 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:37.640255 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:37.640763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:37.642177 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:37.642889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:37.780026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:37.788910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-818db6dc-f466-446c-b0df-0a9576b53850 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.160729 Jun 21 18:38:37.789593 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 531/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:37 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:38.807382 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:38.807990 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:38.809822 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:38.816099 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:38.816575 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:38.817342 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:38.817776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:38.955433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:38.962983 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-819bb414-66c1-44e9-b50d-91ce040df068 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.159569 Jun 21 18:38:38.963548 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 545/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:38 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:39.981893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:39.982512 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:39.985659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=8 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:39.991218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:39.991670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:39.992469 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:39.992909 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:40.135561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:40.144005 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-06e3aaf5-39f1-4a41-a381-3d069983a70a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.166204 Jun 21 18:38:40.144623 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 532/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:39 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:41.163369 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:41.163995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:41.166317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=10 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:41.171391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:41.175311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:41.175311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:41.175311 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:41.324095 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:41.333349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5289c6e3-d795-4bc0-a24d-a6dc1d898fc9 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.173818 Jun 21 18:38:41.333937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 546/1078] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:41 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:42.351923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:42.352689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:42.359662 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:42.360177 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:42.360976 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:42.361422 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:42.502148 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:42.510726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1952749a-c082-4a03-94f9-a0e9d5b21135 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.163187 Jun 21 18:38:42.511302 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 533/1079] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:42 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:42.525974 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b58bcffc-5703-4b17-bb17-244e77650d17 req-e2cd075f-3288-4096-aa94-355366109345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2daa55-5d35-445b-a992-935bedc24fca", "name": "network-vif-plugged", "status": "completed", "tag": "f8178e73-588f-44c9-a5b5-270e31761fe2"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:42.535105 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b58bcffc-5703-4b17-bb17-244e77650d17 req-e2cd075f-3288-4096-aa94-355366109345 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:42.535583 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b58bcffc-5703-4b17-bb17-244e77650d17 req-e2cd075f-3288-4096-aa94-355366109345 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:42.548383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b58bcffc-5703-4b17-bb17-244e77650d17 req-e2cd075f-3288-4096-aa94-355366109345 service nova] Creating event network-vif-plugged:f8178e73-588f-44c9-a5b5-270e31761fe2 for instance 5e2daa55-5d35-445b-a992-935bedc24fca on hv-cinder-83124 Jun 21 18:38:42.555286 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b58bcffc-5703-4b17-bb17-244e77650d17 req-e2cd075f-3288-4096-aa94-355366109345 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102590 Jun 21 18:38:42.555896 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 547/1080] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:43.527328 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:43.527939 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:43.535299 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:43.535908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:43.536714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:43.537156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:43.674661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:43.682411 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d1387745-5fb2-4b02-8c86-1dbdbcb14a50 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1364 microversion: 2.1 time: 0.158883 Jun 21 18:38:43.682985 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 534/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:43 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:44.700288 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:44.701025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:44.707532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:44.707971 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:44.708804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:44.709240 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:44.856038 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:44.865025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f796888d-2997-4c36-ab3b-f11a9ade620e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1550 microversion: 2.1 time: 0.169460 Jun 21 18:38:44.881858 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 548/1082] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:44 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:44.889166 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:44.889671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:44.896553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:44.897004 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:44.897772 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:44.898208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:44.977020 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b0aa4735-f7f2-4f96-8314-6a69214bff6b tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091676 Jun 21 18:38:44.982405 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 535/1083] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Jun 21 18:38:44 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:46.283551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-cfdf4e38-b782-4100-b5a1-e7f2e6369ede req-7f68a083-7983-456c-8731-6e2e84627b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2daa55-5d35-445b-a992-935bedc24fca", "tag": "f8178e73-588f-44c9-a5b5-270e31761fe2"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:46.293023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-cfdf4e38-b782-4100-b5a1-e7f2e6369ede req-7f68a083-7983-456c-8731-6e2e84627b94 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:46.302428 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-cfdf4e38-b782-4100-b5a1-e7f2e6369ede req-7f68a083-7983-456c-8731-6e2e84627b94 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:46.306005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-cfdf4e38-b782-4100-b5a1-e7f2e6369ede req-7f68a083-7983-456c-8731-6e2e84627b94 service nova] Creating event network-changed:f8178e73-588f-44c9-a5b5-270e31761fe2 for instance 5e2daa55-5d35-445b-a992-935bedc24fca on hv-cinder-83124 Jun 21 18:38:46.311072 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-cfdf4e38-b782-4100-b5a1-e7f2e6369ede req-7f68a083-7983-456c-8731-6e2e84627b94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031259 Jun 21 18:38:46.311915 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 549/1084] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:07.959226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:39:07.959980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:39:15.623834 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:15.624694 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:15.628619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:15.629117 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:15.636704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:15.637163 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:15.638016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:15.638458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:15.662145 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-04c9e4e0-821e-460a-8f10-5f0b7f16220c tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/ips" status: 200 len: 146 microversion: 2.1 time: 0.039734 Jun 21 18:39:15.662718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 536/1085] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Jun 21 18:39:15 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:17.243158 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b047737-f399-47be-9632-c8ef59affac2"}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:17.244345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:17.246629 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:17.247314 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=68 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:17.252317 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:17.257188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:17.257188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:17.257188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:18.022854 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b5386e5e-2672-4ade-86c6-4f6e5a27d022 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783825 Jun 21 18:39:18.023458 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 550/1086] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:39:17 2022] POST /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:25.513761 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:25.514692 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:25.522264 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:25.522721 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:25.523486 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:25.523925 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:25.555960 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f00cbf04-dd08-4852-bf49-dbe6788e4137 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Jun 21 18:39:25.557010 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 537/1087] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:39:25 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:25.567993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:25.568617 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:25.575313 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:25.575804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:25.576594 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:25.577025 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:25.607451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0a610755-ab36-4a16-96da-e969e9b58a6d tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2" status: 200 len: 194 microversion: 2.1 time: 0.044382 Jun 21 18:39:25.608020 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 551/1088] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jun 21 18:39:25 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:27.197126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e2bafb8-d8e5-411b-b3cf-de7f7943dd71"}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:27.198310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:27.205767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:27.218432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:27.218432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:27.218432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:27.931003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a6cf6899-d5a2-44b7-b990-5631d3b8b75e tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "POST /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738419 Jun 21 18:39:27.931665 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 538/1089] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Jun 21 18:39:27 2022] POST /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:35.429395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:35.431620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:35.438254 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.438695 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.439481 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.439909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.470911 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e8699c3d-f59e-4e28-a032-135b93f9b4a4 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045740 Jun 21 18:39:35.471464 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 552/1090] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:39:35 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:35.611639 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:35.612239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:35.619508 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.619963 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.620864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.621310 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.651677 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1aa09003-69fd-4439-86c0-f56604649dfa tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2" status: 200 len: 194 microversion: 2.1 time: 0.044979 Jun 21 18:39:35.652267 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 539/1091] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jun 21 18:39:35 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:35.661879 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:35.662398 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:35.669758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.670202 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.670961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:35.671392 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:35.753086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lazy-loading 'services' on Instance uuid 5e2daa55-5d35-445b-a992-935bedc24fca {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:39:35.964840 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2917917c-12a2-4063-baf7-a24092b62a65 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2" status: 202 len: 0 microversion: 2.1 time: 0.306673 Jun 21 18:39:35.965427 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 553/1092] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:39:35 2022] DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/9b047737-f399-47be-9632-c8ef59affac2 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:39:37.078482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:37.079763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:37.087042 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:37.087490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:37.088292 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:37.089856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:37.118989 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b6d2929b-4973-4200-a387-9b5b12c2b728 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/4e2bafb8-d8e5-411b-b3cf-de7f7943dd71" status: 200 len: 194 microversion: 2.1 time: 0.044578 Jun 21 18:39:37.120088 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 540/1093] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Jun 21 18:39:37 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/4e2bafb8-d8e5-411b-b3cf-de7f7943dd71 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:37.131702 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:37.134473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:37.140999 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:37.141527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:37.142306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:37.142752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:37.227053 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lazy-loading 'services' on Instance uuid 5e2daa55-5d35-445b-a992-935bedc24fca {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:39:37.438718 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e1eeb586-7969-46cd-a85b-0c1446ba7b23 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/4e2bafb8-d8e5-411b-b3cf-de7f7943dd71" status: 202 len: 0 microversion: 2.1 time: 0.311937 Jun 21 18:39:37.439309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 554/1094] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Jun 21 18:39:37 2022] DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments/4e2bafb8-d8e5-411b-b3cf-de7f7943dd71 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:39:38.595856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:38.597891 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:38.603629 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.604162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.604965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.605433 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.637151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d3aa253b-bb27-4e34-ab6b-beb7cf9c35f1 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044607 Jun 21 18:39:38.637893 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 541/1095] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:39:38 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:39:38.742869 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:38.743973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:38.750895 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.751353 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.752127 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.752601 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.782812 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-e7137e79-94d1-4d9b-b302-4eec34f55c67 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044657 Jun 21 18:39:38.783289 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 555/1096] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Jun 21 18:39:38 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:39:38.841704 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:38.842200 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:38.848184 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.848669 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.849446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:38.849874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:38.876012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Going to try to terminate instance {{(pid=118472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:39:39.161262 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aa6f2e7f-eb55-42e4-ba22-f88b08b289e2 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 204 len: 0 microversion: 2.1 time: 0.324277 Jun 21 18:39:39.161859 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 542/1097] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:39:38 2022] DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:39:39.170235 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:39.170917 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:39.177143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:39.177589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:39.178349 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:39.178780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:39.313825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:39.321417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1d797b8b-5a59-492c-8512-ab68361e5ed0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1675 microversion: 2.1 time: 0.155193 Jun 21 18:39:39.322146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 556/1098] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:39 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:40.339768 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:40.341238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:40.347638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:40.348084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:40.348871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:40.349311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:40.479268 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:40.486873 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-496f298f-5163-4ef5-af63-c9edb9a5dd97 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1675 microversion: 2.1 time: 0.151318 Jun 21 18:39:40.487436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 543/1099] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:40 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:41.503839 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:41.504505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:41.511282 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:41.511734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:41.512568 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:41.513019 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:41.578445 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:41.587233 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-001097e2-cf9c-4bcc-9f00-db689865f60f tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1607 microversion: 2.1 time: 0.086851 Jun 21 18:39:41.599489 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 557/1100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:41 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:41.865603 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-d633614e-f7fe-4def-a365-f2d0c01a00b0 req-d5abfaef-4327-43d8-8fad-8757041ff83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2daa55-5d35-445b-a992-935bedc24fca", "name": "network-vif-deleted", "tag": "f8178e73-588f-44c9-a5b5-270e31761fe2"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:41.875215 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d633614e-f7fe-4def-a365-f2d0c01a00b0 req-d5abfaef-4327-43d8-8fad-8757041ff83b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:41.875663 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-d633614e-f7fe-4def-a365-f2d0c01a00b0 req-d5abfaef-4327-43d8-8fad-8757041ff83b service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:41.888034 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-d633614e-f7fe-4def-a365-f2d0c01a00b0 req-d5abfaef-4327-43d8-8fad-8757041ff83b service nova] Creating event network-vif-deleted:f8178e73-588f-44c9-a5b5-270e31761fe2 for instance 5e2daa55-5d35-445b-a992-935bedc24fca on hv-cinder-83124 Jun 21 18:39:41.893362 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-d633614e-f7fe-4def-a365-f2d0c01a00b0 req-d5abfaef-4327-43d8-8fad-8757041ff83b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Jun 21 18:39:41.893965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 544/1101] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:42.605031 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:42.605762 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:42.613064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:42.624108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:42.624108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:42.624108 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:42.650620 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:42.651063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:42.651514 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.objects.instance [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lazy-loading 'fault' on Instance uuid 5e2daa55-5d35-445b-a992-935bedc24fca {{(pid=118474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:39:42.698023 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b424248bfb84fe4a25269232e08dcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466c7ed97ff34cd7824164207ab764d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:42.706417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7fb271ec-6343-4ad1-a828-9d9e89279889 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 200 len: 1328 microversion: 2.1 time: 0.105228 Jun 21 18:39:42.706995 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 558/1102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:42 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:43.725162 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:43.725868 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:43.732578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:43.733763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:43.733993 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:43.734434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:43.748383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca HTTP/1.1 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:39:43.750069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:43.751770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '5e2daa55-5d35-445b-a992-935bedc24fca'} Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:43.753137 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:43.755493 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:43.757084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:43.757084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-7a4c4b65-ccda-4071-92b1-4c660092f04a tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 404 len: 111 microversion: 2.1 time: 0.031165 Jun 21 18:39:43.757084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 545/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:43 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:39:43.760626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9724ee65-802c-427e-b3ad-4fab175b7ef7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '.version_select at 0x7fd3977a9670>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:43.897148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9724ee65-802c-427e-b3ad-4fab175b7ef7 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062812981" status: 202 len: 0 microversion: 2.1 time: 0.140524 Jun 21 18:39:43.899499 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 559/1104] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Jun 21 18:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062812981 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:39:47.198040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:47.198553 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:47.205035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:47.205488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:47.206257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:47.206691 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:47.220654 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca HTTP/1.1 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:39:47.222188 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.223980 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '5e2daa55-5d35-445b-a992-935bedc24fca'} Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:47.224870 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.226490 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.228185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:47.228185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-762d3558-4e16-41a7-8f48-dff8ab739148 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 404 len: 111 microversion: 2.1 time: 0.029435 Jun 21 18:39:47.228185 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 546/1105] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:39:47 2022] DELETE /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:39:47.232590 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:47.233661 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 5e2daa55-5d35-445b-a992-935bedc24fca] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:47.240529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:47.240990 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:47.241759 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:47.242201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:47.256123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca HTTP/1.1 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:39:47.257823 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.259572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '5e2daa55-5d35-445b-a992-935bedc24fca'} Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:47.260363 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. Jun 21 18:39:47.262001 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:47.263733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 5e2daa55-5d35-445b-a992-935bedc24fca could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:47.263733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-f2aafd28-b8b9-4de3-9e49-4aa7b8093b98 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca" status: 404 len: 111 microversion: 2.1 time: 0.031236 Jun 21 18:39:47.263733 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 560/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:47 2022] GET /compute/v2.1/servers/5e2daa55-5d35-445b-a992-935bedc24fca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:39:48.519572 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:48.520089 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:48.526440 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:48.526884 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:48.527638 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:48.528090 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:48.541804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 HTTP/1.1 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:39:48.543321 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.545044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': '3ff510c5-0fac-44d2-8c03-adc9c7952b43'} Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:48.546175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.547747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.549611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:48.549611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-6c910790-2108-433e-8e74-977e42f81593 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 404 len: 111 microversion: 2.1 time: 0.028944 Jun 21 18:39:48.549611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 547/1107] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:39:48 2022] DELETE /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:39:48.554429 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:48.555054 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] [instance: 3ff510c5-0fac-44d2-8c03-adc9c7952b43] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:48.557507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:48.562849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:48.563304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:48.564074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:48.564551 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:48.567141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:48.579362 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] HTTP exception thrown: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Request method failure captured: Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 HTTP/1.1 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABisg9lEhI5-dVFgpCb0LN_aSCiXdozFTgea71h5W1wYzSsKFvlwe9jjYJAINmCQ2c04ByiCXrWDPYWiC7vshB2Oh00jeW9DTyuKe1jus7ANkVSrBGCSKkiuj0iI0R6mM4FsjNrLxS_QdTyzwaoHgJuaESrL4zz_ZVLRy53l6X_mC0iwUk Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:39:48.580937 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/466c7ed97ff34cd7824164207ab764d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: 466c7ed97ff34cd7824164207ab764d0 Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1525614673 Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 5b424248bfb84fe4a25269232e08dcaf Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-AttachVolumeTestJSON-1525614673-project Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.582635 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': '3ff510c5-0fac-44d2-8c03-adc9c7952b43'} Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:48.583647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. Jun 21 18:39:48.585219 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:39:48.586619 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] Returning 404 to user: Instance 3ff510c5-0fac-44d2-8c03-adc9c7952b43 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:48.586619 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-09dfe7e8-254a-4ba0-b083-5f6bc80510f0 tempest-AttachVolumeTestJSON-1525614673 tempest-AttachVolumeTestJSON-1525614673-project] 10.222.0.23 "GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43" status: 404 len: 111 microversion: 2.1 time: 0.031821 Jun 21 18:39:48.586619 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 561/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:48 2022] GET /compute/v2.1/servers/3ff510c5-0fac-44d2-8c03-adc9c7952b43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:40:49.107548 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:49.108297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:49.303470 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-a9ec6b13-936d-4a1a-a2f2-826fe52fefff tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Action: 'create', calling method: .version_select at 0x7fd39c19a8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-710883758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIHVDMJK/Zw9lFChhlz6hk3e1W/8PEypOzMK71jx3dohckb0jElkVerj0f/+kpsltrdTdwtVkQZ5/SPKO2vpJUEx/5+fOcdnIbNvgHh+Zhoud7JlGAbRuPbQ/jCojv7xg=="}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:49.318116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a9ec6b13-936d-4a1a-a2f2-826fe52fefff tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for project de887ac9630748ff80970b49454025fd. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:40:49.323127 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-a9ec6b13-936d-4a1a-a2f2-826fe52fefff tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for user 35dc91771b734cf8a4da79fa4971548e and project de887ac9630748ff80970b49454025fd. Resources: {'key_pairs'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:40:49.442592 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-a9ec6b13-936d-4a1a-a2f2-826fe52fefff tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.336673 Jun 21 18:40:49.443750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 548/1109] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Jun 21 18:40:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:41:07.635656 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1734978155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710883758", "security_groups": [{"name": "tempest-secgroup-smoke-674080289"}], "block_device_mapping_v2": [{"uuid": "87ca3735-94e0-42ab-a6ae-d78077e5a589", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01fb5a15-cdfd-4e78-89b6-9fe76da7ff03"}]}} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:07.753758 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.network.neutron [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] validate_networks() for [('01fb5a15-cdfd-4e78-89b6-9fe76da7ff03', None, None, None, None, None)] {{(pid=118474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:41:08.211832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:41:08.212263 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image limits 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:41:08.212782 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:41:08.213206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image pref 0:0:0 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:41:08.213621 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.virt.hardware [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:41:08.223066 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.223517 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.224326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.224799 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.241205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:41:08.245141 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.quota [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for user 35dc91771b734cf8a4da79fa4971548e and project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:41:08.302078 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Going to run 1 instances... {{(pid=118474) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:41:08.304146 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87ca3735-94e0-42ab-a6ae-d78077e5a589',volume_size=None,volume_type=None)] {{(pid=118474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:41:08.736402 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-655a726f-5822-40b3-879f-dc9f35c9bbbd tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.107332 Jun 21 18:41:08.737193 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 562/1110] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:41:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:41:08.744878 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=4 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:08.745659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:08.750567 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-4c463bb7-c3bd-47b0-af7e-88001ee32d60 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:08.751628 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-4c463bb7-c3bd-47b0-af7e-88001ee32d60 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:08.809698 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-4c463bb7-c3bd-47b0-af7e-88001ee32d60 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:08.817441 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-4c463bb7-c3bd-47b0-af7e-88001ee32d60 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1094 microversion: 2.1 time: 0.074164 Jun 21 18:41:08.818016 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 549/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:08 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:09.835232 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:09.835821 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:09.842529 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.842973 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:09.846991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.846991 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:09.911993 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:09.919951 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1288fc51-1fb1-43ce-a9f6-ecfaa4bad5f3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1144 microversion: 2.1 time: 0.089126 Jun 21 18:41:09.920541 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 563/1112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:09 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:10.938040 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:10.939239 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:10.945465 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:10.946087 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:10.946880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:10.947330 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:11.027592 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:11.039570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9829aea3-8f48-452d-a50b-0f6057314cb7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1200 microversion: 2.1 time: 0.102582 Jun 21 18:41:11.039570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 550/1113] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:10 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:12.055409 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:12.056701 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:12.063610 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.064257 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.065248 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.065684 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.203267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:12.210850 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ba0eb64e-3877-4030-a42c-5449304c9edb tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1277 microversion: 2.1 time: 0.160500 Jun 21 18:41:12.211417 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 564/1114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:12 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:41:12.717367 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-0f177fbe-3a63-42ce-8868-4033c5518059 req-f9df32b7-3302-47df-9bb4-a861168b1437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac10aa08-fb28-4f5c-afca-d4a1f5d9a219", "tag": "1d60dc38-ae85-4634-ac08-cbf6c159b8cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:12.726659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0f177fbe-3a63-42ce-8868-4033c5518059 req-f9df32b7-3302-47df-9bb4-a861168b1437 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.727084 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-0f177fbe-3a63-42ce-8868-4033c5518059 req-f9df32b7-3302-47df-9bb4-a861168b1437 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.743563 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-0f177fbe-3a63-42ce-8868-4033c5518059 req-f9df32b7-3302-47df-9bb4-a861168b1437 service nova] Creating event network-changed:1d60dc38-ae85-4634-ac08-cbf6c159b8cd for instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 on hv-cinder-83124 Jun 21 18:41:12.745001 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-0f177fbe-3a63-42ce-8868-4033c5518059 req-f9df32b7-3302-47df-9bb4-a861168b1437 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031586 Jun 21 18:41:12.745595 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 551/1115] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:41:13.230407 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:13.231206 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:13.238468 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:13.238920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:13.239691 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:13.240130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:13.374647 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:13.382123 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9a0d57df-7a4c-458b-88c4-88fcb4b0a716 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.155960 Jun 21 18:41:13.382703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 565/1116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:13 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:14.400658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:14.401354 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:14.408671 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.409118 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.409880 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.410311 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.550314 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:14.557897 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-52d2418c-0713-421e-8345-3706d7574ff3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.162102 Jun 21 18:41:14.561300 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 552/1117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:14 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:15.575811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:15.577018 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:15.583494 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.583939 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.584731 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.585166 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.718787 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:15.726477 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b8cf3065-e39d-4e39-852c-5700dc12f7c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.155159 Jun 21 18:41:15.727048 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 566/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:15 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:16.743466 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:16.744071 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:16.751673 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:16.752121 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:16.752923 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:16.753661 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:16.895726 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:16.903077 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-ccfb5e98-5117-44e9-8084-0d5d944f6b19 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.163730 Jun 21 18:41:16.903933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 553/1119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:16 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:17.920237 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:17.920882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:17.927443 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.927887 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.928686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.929119 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:18.084006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:18.084006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5726105d-f2d6-411a-851c-8b2d6896465f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.153456 Jun 21 18:41:18.084006 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 567/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:17 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:19.087489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:19.088126 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:19.090574 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:19.096701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:19.097154 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:19.097913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:19.098375 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:19.229596 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:19.237404 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-e9fd7f22-0a93-4e20-a687-52f6b417cb24 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.153775 Jun 21 18:41:19.241750 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 554/1121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:19 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:20.254281 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:20.254891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:20.256742 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:20.257395 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=6 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:20.264005 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:20.264556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:20.265332 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:20.265799 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:20.401148 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:20.409226 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ac5307a8-0b03-44f8-a66e-c9c535c94014 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.158872 Jun 21 18:41:20.409788 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 568/1122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:20 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:21.425350 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:21.426047 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:21.432705 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.433164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.433948 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.434390 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.572452 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:21.580808 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-41716aa7-edf8-49a9-a21c-d1e0fd8ad8ae tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.159320 Jun 21 18:41:21.581389 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 555/1123] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:21 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:22.598188 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:22.598825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:22.605377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.607082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.607304 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.607752 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.737021 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:22.744488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7cf43515-4ba5-47e4-b4e9-43b9a07b9284 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.150185 Jun 21 18:41:22.745057 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 569/1124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:22 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:23.083083 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-43ac8b5b-bdb0-4447-932a-17e712ef0216 req-ebed1064-55f0-4a02-9b5f-8ad8a6334e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac10aa08-fb28-4f5c-afca-d4a1f5d9a219", "name": "network-vif-plugged", "status": "completed", "tag": "1d60dc38-ae85-4634-ac08-cbf6c159b8cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:23.091635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-43ac8b5b-bdb0-4447-932a-17e712ef0216 req-ebed1064-55f0-4a02-9b5f-8ad8a6334e22 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.092076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-43ac8b5b-bdb0-4447-932a-17e712ef0216 req-ebed1064-55f0-4a02-9b5f-8ad8a6334e22 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.103756 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-43ac8b5b-bdb0-4447-932a-17e712ef0216 req-ebed1064-55f0-4a02-9b5f-8ad8a6334e22 service nova] Creating event network-vif-plugged:1d60dc38-ae85-4634-ac08-cbf6c159b8cd for instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 on hv-cinder-83124 Jun 21 18:41:23.108730 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-43ac8b5b-bdb0-4447-932a-17e712ef0216 req-ebed1064-55f0-4a02-9b5f-8ad8a6334e22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029297 Jun 21 18:41:23.109349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 556/1125] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:41:23.766987 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:23.767558 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:23.774014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.774457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.775221 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.775650 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.913998 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:23.921982 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9c9b4401-f659-4644-b71a-db6f405cb1c8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1265 microversion: 2.1 time: 0.164063 Jun 21 18:41:23.922543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 570/1126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:23 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:24.940171 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:24.940896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:24.947133 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:24.947578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:24.948526 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:24.948901 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:25.085078 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:25.093050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b65cd42b-7ed3-4e2c-9ab7-d0f0333eee89 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1451 microversion: 2.1 time: 0.157699 Jun 21 18:41:25.093619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 557/1127] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:24 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:25.109784 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:25.110722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:25.117421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:25.117880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:25.118657 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:25.119107 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:25.253922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:25.262179 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-1a2987fc-d27d-45ca-a796-730eb2af64d8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1451 microversion: 2.1 time: 0.157201 Jun 21 18:41:25.262864 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 571/1128] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:25 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:27.510618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-32d19220-1949-4fb3-8499-2eb7b6336718 req-ddbce459-4f0e-478a-9ef6-c6eb881b7610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac10aa08-fb28-4f5c-afca-d4a1f5d9a219", "tag": "1d60dc38-ae85-4634-ac08-cbf6c159b8cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:27.519494 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-32d19220-1949-4fb3-8499-2eb7b6336718 req-ddbce459-4f0e-478a-9ef6-c6eb881b7610 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:27.519946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-32d19220-1949-4fb3-8499-2eb7b6336718 req-ddbce459-4f0e-478a-9ef6-c6eb881b7610 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:27.531611 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-32d19220-1949-4fb3-8499-2eb7b6336718 req-ddbce459-4f0e-478a-9ef6-c6eb881b7610 service nova] Creating event network-changed:1d60dc38-ae85-4634-ac08-cbf6c159b8cd for instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 on hv-cinder-83124 Jun 21 18:41:27.536811 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-32d19220-1949-4fb3-8499-2eb7b6336718 req-ddbce459-4f0e-478a-9ef6-c6eb881b7610 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030236 Jun 21 18:41:27.537425 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 558/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:42:27.969136 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:42:27.969940 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:42:43.460377 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:42:43.461046 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:42:52.545563 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:42:52.546488 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:42:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:43:22.751143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:22.752722 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=57 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:22.756384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:22.756916 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:22.763063 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:22.768945 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:22.768945 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:22.768945 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:22.792586 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:43:23.091645 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-2fec3931-73be-4c74-b82b-6bea594660f2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 204 len: 0 microversion: 2.1 time: 0.342050 Jun 21 18:43:23.092151 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 572/1130] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:43:22 2022] DELETE /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:43:23.099981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=22 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:23.100745 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=42 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:23.105029 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:23.105718 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:23.113465 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.113908 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:23.114664 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.115094 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:23.295504 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:23.303689 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-af1356b6-a6b3-427b-86ec-518d401c5848 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1575 microversion: 2.1 time: 0.205928 Jun 21 18:43:23.304256 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 559/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:23 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:24.322271 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:24.322981 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:24.329224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:24.329675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:24.330480 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:24.330917 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:24.517899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:24.525727 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5493c6ea-5b2f-4682-ba32-783026f3c5a9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1575 microversion: 2.1 time: 0.207776 Jun 21 18:43:24.526520 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 573/1132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:24 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:25.543295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:25.544201 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:25.555268 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.558315 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.559645 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.560161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.570219 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-8b5a0f84-40b4-4146-b773-8619ea304442 req-fd3028d5-b79b-4ac8-8960-cbb51bd70ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac10aa08-fb28-4f5c-afca-d4a1f5d9a219", "name": "network-vif-deleted", "tag": "1d60dc38-ae85-4634-ac08-cbf6c159b8cd"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:25.592528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8b5a0f84-40b4-4146-b773-8619ea304442 req-fd3028d5-b79b-4ac8-8960-cbb51bd70ea8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.593050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8b5a0f84-40b4-4146-b773-8619ea304442 req-fd3028d5-b79b-4ac8-8960-cbb51bd70ea8 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.607110 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-8b5a0f84-40b4-4146-b773-8619ea304442 req-fd3028d5-b79b-4ac8-8960-cbb51bd70ea8 service nova] Creating event network-vif-deleted:1d60dc38-ae85-4634-ac08-cbf6c159b8cd for instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 on hv-cinder-83124 Jun 21 18:43:25.619135 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-8b5a0f84-40b4-4146-b773-8619ea304442 req-fd3028d5-b79b-4ac8-8960-cbb51bd70ea8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118034 Jun 21 18:43:25.624715 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 560/1133] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:25.663125 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:25.671308 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7c55bf98-1c2a-43ab-863b-733f74ed7f16 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1508 microversion: 2.1 time: 0.132046 Jun 21 18:43:25.672295 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 574/1134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:25 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1508 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:26.690453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:26.691164 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:26.697806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.698259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.699020 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.699460 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.732711 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.733167 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.733618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.objects.instance [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lazy-loading 'fault' on Instance uuid ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 {{(pid=118472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:43:26.778217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:26.786261 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-b30d9bed-f909-4624-a054-d75ac2e26a99 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 200 len: 1184 microversion: 2.1 time: 0.101392 Jun 21 18:43:26.786849 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 561/1135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:26 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:27.804207 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:27.804832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:27.811285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.811730 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.812511 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.812946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.827532 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] HTTP exception thrown: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Request method failure captured: Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 HTTP/1.1 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABishCqESBm8_LmvLjncM9CTIxXj39mKBpyD9Dy_pqJr4n2vxk3FL0pZn4NidkqAaeIVB6-K-_l1yJiAoJZObXSVRe2IlCpjfKwqOv7g-w8p8RzkaRE2ZiiFc9NU192SpALl_aam2yFdAB44e51zoIUc5lCtFlun8R-W_1KT-QQlSIw0H0 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: de887ac9630748ff80970b49454025fd Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:43:27.829199 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de887ac9630748ff80970b49454025fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de887ac9630748ff80970b49454025fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: de887ac9630748ff80970b49454025fd Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 35dc91771b734cf8a4da79fa4971548e Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:43:27.831778 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'ac10aa08-fb28-4f5c-afca-d4a1f5d9a219'} Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:43:27.832955 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:43:27.834589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:43:27.836085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Returning 404 to user: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:43:27.836085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-0ac89480-165c-400b-978d-b9f6ce936b51 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 404 len: 111 microversion: 2.1 time: 0.031472 Jun 21 18:43:27.836085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 575/1136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:27 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:43:27.879049 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-655197826", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710883758", "security_groups": [{"name": "tempest-secgroup-smoke-674080289"}], "block_device_mapping_v2": [{"uuid": "87ca3735-94e0-42ab-a6ae-d78077e5a589", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01fb5a15-cdfd-4e78-89b6-9fe76da7ff03"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:27.990804 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] validate_networks() for [('01fb5a15-cdfd-4e78-89b6-9fe76da7ff03', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:43:28.414640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:43:28.415058 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:43:28.415528 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:43:28.415931 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:43:28.416339 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:43:28.425584 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.426026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.426818 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.427253 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.443347 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:43:28.447257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for user 35dc91771b734cf8a4da79fa4971548e and project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:43:28.503570 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:43:28.505713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87ca3735-94e0-42ab-a6ae-d78077e5a589',volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:43:28.917454 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d8a36317-b87a-436c-a1e1-8eec880b79fa tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.042675 Jun 21 18:43:28.922765 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 562/1137] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:43:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:43:28.928255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-bfa66d93-51d5-4efd-bc5a-b3f5bcb89f2a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:28.928909 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-bfa66d93-51d5-4efd-bc5a-b3f5bcb89f2a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:28.981329 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-bfa66d93-51d5-4efd-bc5a-b3f5bcb89f2a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:28.988205 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-bfa66d93-51d5-4efd-bc5a-b3f5bcb89f2a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1093 microversion: 2.1 time: 0.063798 Jun 21 18:43:28.988794 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 576/1138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:28 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:30.005701 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-65be6983-a3f5-4035-ab1b-9514d780a3ee tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:30.006322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-65be6983-a3f5-4035-ab1b-9514d780a3ee tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:30.065658 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-65be6983-a3f5-4035-ab1b-9514d780a3ee tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:30.072323 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-65be6983-a3f5-4035-ab1b-9514d780a3ee tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1093 microversion: 2.1 time: 0.071267 Jun 21 18:43:30.072916 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 563/1139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:29 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:31.089883 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-ea04f9ed-21cd-420f-bef2-6ba0cc6b15c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:31.090472 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-ea04f9ed-21cd-420f-bef2-6ba0cc6b15c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:31.146384 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-ea04f9ed-21cd-420f-bef2-6ba0cc6b15c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:31.153637 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-ea04f9ed-21cd-420f-bef2-6ba0cc6b15c1 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1093 microversion: 2.1 time: 0.067848 Jun 21 18:43:31.154212 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 577/1140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:31 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:32.170501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-83658179-1f82-4bf4-8cc4-370ee8a9ba31 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:32.171106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-83658179-1f82-4bf4-8cc4-370ee8a9ba31 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:32.222986 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-83658179-1f82-4bf4-8cc4-370ee8a9ba31 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:32.229585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-83658179-1f82-4bf4-8cc4-370ee8a9ba31 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1093 microversion: 2.1 time: 0.062985 Jun 21 18:43:32.230143 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 564/1141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:32 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:33.246309 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:33.246921 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:33.254224 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.254680 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:33.255457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.255899 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:33.318216 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:33.325668 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-7d2574a3-0920-49c5-88d2-7cc1cc3b4817 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1143 microversion: 2.1 time: 0.083331 Jun 21 18:43:33.326236 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 578/1142] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:33 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:34.342396 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:34.343041 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:34.350747 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:34.351192 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:34.351965 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:34.352434 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:34.412476 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:34.420043 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-df6a1ca0-f4a9-4a1c-b768-6d6a5d520658 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1135 microversion: 2.1 time: 0.081573 Jun 21 18:43:34.420634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 565/1143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:34 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:35.437675 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:35.438331 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:35.445032 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:35.445479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:35.446238 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:35.446671 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:35.512467 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:35.521934 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c13ca74e-e66c-4558-93a6-dcd90bc7f0b5 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1209 microversion: 2.1 time: 0.088247 Jun 21 18:43:35.522455 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 579/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:35 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:36.539193 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:36.539787 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:36.546453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.546910 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.547696 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.548141 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.695175 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:36.703021 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-601a26d2-bb81-432f-b8ef-667513a419ef tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.167750 Jun 21 18:43:36.703586 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 566/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:36 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:37.064015 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-8af29803-5394-40e2-a471-168a3109a91c req-27c819d2-dc2a-4b04-a640-2b12c94d5657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e341de57-0877-44a7-8a94-84a7d0818e25", "tag": "522e98cb-e9d1-4288-92da-7810162ca2f0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:37.076525 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-8af29803-5394-40e2-a471-168a3109a91c req-27c819d2-dc2a-4b04-a640-2b12c94d5657 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.076969 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-8af29803-5394-40e2-a471-168a3109a91c req-27c819d2-dc2a-4b04-a640-2b12c94d5657 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.089914 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-8af29803-5394-40e2-a471-168a3109a91c req-27c819d2-dc2a-4b04-a640-2b12c94d5657 service nova] Creating event network-changed:522e98cb-e9d1-4288-92da-7810162ca2f0 for instance e341de57-0877-44a7-8a94-84a7d0818e25 on hv-cinder-83124 Jun 21 18:43:37.095855 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-8af29803-5394-40e2-a471-168a3109a91c req-27c819d2-dc2a-4b04-a640-2b12c94d5657 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036252 Jun 21 18:43:37.096687 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 580/1146] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:37.721022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:37.721618 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:37.728160 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.728642 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.729406 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.729843 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.873432 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:37.881933 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-95d5f613-5a4a-4a03-adef-92070f7544b3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.164799 Jun 21 18:43:37.882511 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 567/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:37 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:38.900746 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:38.901441 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:38.907623 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:38.908064 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:38.908849 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:38.909321 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:39.040330 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:39.048132 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b303409c-47aa-40a4-8c42-c16f1350ee07 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.152426 Jun 21 18:43:39.048745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 581/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:38 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:40.065119 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:40.065763 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:40.067882 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:40.073529 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:40.076578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:40.076578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:40.076578 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:40.213453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:40.220869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-2f8dd90a-ba29-44ad-a847-47028737d0fe tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.159700 Jun 21 18:43:40.221435 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 568/1149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:40 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:41.238255 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:41.238950 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:41.241391 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=4 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:41.246270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:41.246715 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:41.247484 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:41.247920 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:41.382793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:41.390527 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5e8f8eff-5cbb-4e0e-a566-41079cd7bcb8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.156771 Jun 21 18:43:41.391082 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 582/1150] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:41 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:42.408296 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:42.408929 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:42.411634 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=10 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:42.416412 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:42.416869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:42.417619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:42.418046 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:42.552686 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:42.560128 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-1333db8f-9cab-4fa7-8591-5e899cde5afc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.155744 Jun 21 18:43:42.560713 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 569/1151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:42 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:43.577626 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:43.578267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:43.585091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:43.585542 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:43.586306 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:43.586745 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:43.719386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:43.727543 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-d70094f8-5153-4419-b7cd-402533e799b2 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.153783 Jun 21 18:43:43.728110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 583/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:43 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:44.744794 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:44.745480 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:44.751955 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:44.752424 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:44.753819 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:44.754259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:44.891998 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:44.900458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-f1c4a7c9-b44e-4de1-b0db-dcdd3489c91b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.159479 Jun 21 18:43:44.901032 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 570/1153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:44 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:45.917616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:45.918339 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:45.925153 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:45.925615 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:45.926394 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:45.926832 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:46.064365 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:46.072340 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-be90718f-5ad3-46bf-a7ac-9784523294e8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.158594 Jun 21 18:43:46.073344 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 584/1154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:45 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:47.089874 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:47.090543 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:47.097241 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:47.097683 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:47.098438 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:47.098871 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:47.229568 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:47.237006 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-df0593e1-219f-4a08-9285-9895706ed52b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.151000 Jun 21 18:43:47.237991 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 571/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:47 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:47.833738 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-765b0722-9272-4dc5-af79-bc4c890593d3 req-e2856ebc-2b00-427f-8916-2bb14301fe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e341de57-0877-44a7-8a94-84a7d0818e25", "name": "network-vif-plugged", "status": "completed", "tag": "522e98cb-e9d1-4288-92da-7810162ca2f0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:47.841961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-765b0722-9272-4dc5-af79-bc4c890593d3 req-e2856ebc-2b00-427f-8916-2bb14301fe07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:47.842405 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-765b0722-9272-4dc5-af79-bc4c890593d3 req-e2856ebc-2b00-427f-8916-2bb14301fe07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:47.854505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-765b0722-9272-4dc5-af79-bc4c890593d3 req-e2856ebc-2b00-427f-8916-2bb14301fe07 service nova] Creating event network-vif-plugged:522e98cb-e9d1-4288-92da-7810162ca2f0 for instance e341de57-0877-44a7-8a94-84a7d0818e25 on hv-cinder-83124 Jun 21 18:43:47.859632 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-765b0722-9272-4dc5-af79-bc4c890593d3 req-e2856ebc-2b00-427f-8916-2bb14301fe07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089587 Jun 21 18:43:47.860245 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 585/1156] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:48.253793 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:48.254538 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:48.261102 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:48.261557 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:48.262583 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:48.263026 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:48.392723 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:48.400314 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9836d492-7706-4c63-90e1-2a8bcd1f75c7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1264 microversion: 2.1 time: 0.150495 Jun 21 18:43:48.400915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 572/1157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:48 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:49.418460 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:49.419161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:49.425375 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:49.425830 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:49.426779 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:49.427270 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:49.574791 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:49.583820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-71e26381-8f34-4170-868a-299ea013886a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1450 microversion: 2.1 time: 0.169928 Jun 21 18:43:49.584436 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 586/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:49 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:49.602251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:49.602946 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:49.610221 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:49.610609 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:49.618297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:49.618297 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:49.745383 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:49.754915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-fdfb1531-b568-4a99-abf8-c02763769b1e tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1450 microversion: 2.1 time: 0.155708 Jun 21 18:43:49.754915 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 573/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:49 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:51.719074 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-2b7a3961-9113-46ff-992d-6ac6d03e59ce req-f4f17433-7f6c-4b00-833c-5a92aff32642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e341de57-0877-44a7-8a94-84a7d0818e25", "tag": "522e98cb-e9d1-4288-92da-7810162ca2f0"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:51.730227 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-2b7a3961-9113-46ff-992d-6ac6d03e59ce req-f4f17433-7f6c-4b00-833c-5a92aff32642 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:51.730660 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-2b7a3961-9113-46ff-992d-6ac6d03e59ce req-f4f17433-7f6c-4b00-833c-5a92aff32642 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:51.742478 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-2b7a3961-9113-46ff-992d-6ac6d03e59ce req-f4f17433-7f6c-4b00-833c-5a92aff32642 service nova] Creating event network-changed:522e98cb-e9d1-4288-92da-7810162ca2f0 for instance e341de57-0877-44a7-8a94-84a7d0818e25 on hv-cinder-83124 Jun 21 18:43:51.747605 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-2b7a3961-9113-46ff-992d-6ac6d03e59ce req-f4f17433-7f6c-4b00-833c-5a92aff32642 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032143 Jun 21 18:43:51.748200 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 587/1160] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:57.354077 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:43:57.354736 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:43:59.976659 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:43:59.977285 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:45:26.204453 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1810409755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710883758", "security_groups": [{"name": "tempest-secgroup-smoke-674080289"}], "block_device_mapping_v2": [{"uuid": "2040d3d4-568a-40d6-894a-bc8c71119be1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "01fb5a15-cdfd-4e78-89b6-9fe76da7ff03"}]}} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:26.213251 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0bdc5fc-6565-46f5-b36e-24b9ce9bc5d0] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 21 18:45:26.213822 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:26.214489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=72 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:26.322648 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.network.neutron [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] validate_networks() for [('01fb5a15-cdfd-4e78-89b6-9fe76da7ff03', None, None, None, None, None)] {{(pid=118472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:45:26.944565 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:45:26.944988 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image limits 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:45:26.945457 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Flavor pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:45:26.945864 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Image pref 0:0:0 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:45:26.946272 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.virt.hardware [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:45:26.955257 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:26.955702 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:26.956542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:26.956981 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:26.973905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:45:26.977640 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.quota [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Getting quotas for user 35dc91771b734cf8a4da79fa4971548e and project de887ac9630748ff80970b49454025fd. Resources: {'cores', 'ram', 'instances'} {{(pid=118472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:45:27.037252 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Going to run 1 instances... {{(pid=118472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:45:27.039279 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2040d3d4-568a-40d6-894a-bc8c71119be1',volume_size=None,volume_type=None)] {{(pid=118472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:45:27.224444 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0bdc5fc-6565-46f5-b36e-24b9ce9bc5d0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37346. Jun 21 18:45:27.469173 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-aaa15850-ead1-40be-9928-b595b781e247 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.269419 Jun 21 18:45:27.469823 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 574/1161] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Jun 21 18:45:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:45:27.479340 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:27.480009 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:27.484457 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c83a09d2-54dd-4760-b38a-6014746f6adc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:27.485161 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c83a09d2-54dd-4760-b38a-6014746f6adc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:27.541769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c83a09d2-54dd-4760-b38a-6014746f6adc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:27.558734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c83a09d2-54dd-4760-b38a-6014746f6adc tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1094 microversion: 2.1 time: 0.081473 Jun 21 18:45:27.569103 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 588/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:27 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:28.577125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:28.577741 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:28.584082 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:28.584653 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:28.585455 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:28.585896 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:28.651898 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:28.660932 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-d7562a17-4b21-4224-a37a-471b443eee6a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1144 microversion: 2.1 time: 0.088397 Jun 21 18:45:28.661585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 575/1163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:28 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:29.678825 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:29.679811 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:29.690058 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:29.690636 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:29.691528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:29.692039 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:29.760106 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:29.779273 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-82bc1f95-5f36-40b3-8ac1-97395b3c4072 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1200 microversion: 2.1 time: 0.104123 Jun 21 18:45:29.780279 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 589/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:29 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:30.799541 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:30.800450 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:30.806868 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:30.807318 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:30.808117 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:30.808892 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:31.000749 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:31.011334 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-462dd9fd-fd76-4806-b24f-7577bc9ee900 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1277 microversion: 2.1 time: 0.216200 Jun 21 18:45:31.012259 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 576/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:30 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:31.310152 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-b020a00b-7440-467d-a382-8cd145dc46b4 req-c9250ffe-18af-48a9-bc9b-02d49c4f22a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2409585-7698-45dd-baf5-1bd79afc8664", "tag": "e616b4da-1d21-4139-8042-635e471c8b83"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:31.328351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b020a00b-7440-467d-a382-8cd145dc46b4 req-c9250ffe-18af-48a9-bc9b-02d49c4f22a4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:31.328351 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-b020a00b-7440-467d-a382-8cd145dc46b4 req-c9250ffe-18af-48a9-bc9b-02d49c4f22a4 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:31.348673 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-b020a00b-7440-467d-a382-8cd145dc46b4 req-c9250ffe-18af-48a9-bc9b-02d49c4f22a4 service nova] Creating event network-changed:e616b4da-1d21-4139-8042-635e471c8b83 for instance c2409585-7698-45dd-baf5-1bd79afc8664 on hv-cinder-83124 Jun 21 18:45:31.354195 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-b020a00b-7440-467d-a382-8cd145dc46b4 req-c9250ffe-18af-48a9-bc9b-02d49c4f22a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049791 Jun 21 18:45:31.354904 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 590/1166] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:45:32.035385 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:32.036125 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:32.043240 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:32.043777 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:32.044585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:32.045014 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:32.182199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:32.190776 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-127492ae-0907-4cf3-8213-fde557db2d29 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.160781 Jun 21 18:45:32.192116 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 577/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:32 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:33.210238 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:33.210946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:33.217842 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:33.218296 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:33.219080 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:33.219589 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:33.359130 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:33.366577 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-03eaed05-a868-4abb-b470-3f269148791a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.162172 Jun 21 18:45:33.367139 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 591/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:33 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:34.383850 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:34.384473 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:34.391218 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:34.391665 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:34.392443 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:34.392882 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:34.523226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:34.530801 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-333e4248-ebe0-40e3-8495-b600fa5415db tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.150821 Jun 21 18:45:34.531356 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 578/1169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:34 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:45:35.548100 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:35.548770 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:35.555780 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:35.556225 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:35.557033 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:35.557468 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:35.694383 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:35.701919 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-68b452e4-0f74-4a57-814e-2c7d1f2b0811 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.158254 Jun 21 18:45:35.702485 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 592/1170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:35 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:36.719023 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:36.719626 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:36.726906 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:36.727349 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:36.728106 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:36.728571 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:36.868022 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:36.875697 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-96c69f7f-4381-402f-b2d2-b1746a786e7c tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.160484 Jun 21 18:45:36.876262 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 579/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:36 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:37.893776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:37.894497 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:37.897051 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell0:SELECT=2 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:37.902299 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:37.902793 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:37.903572 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:37.904036 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:38.053869 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:38.061386 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-b4f699b5-a0c2-41ee-b96b-359153f3aaa7 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.172585 Jun 21 18:45:38.061961 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 593/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:37 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:39.079431 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:39.079968 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:39.082452 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=2 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:39.083107 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell0:SELECT=6 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:39.088366 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:39.088845 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:39.089608 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:39.090044 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:39.222226 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:39.229682 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8a8469eb-2b1d-4c85-8f88-6e36b4bb707a tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.154290 Jun 21 18:45:39.230462 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 580/1173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:39 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:40.246450 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:40.247070 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:40.253930 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:40.254385 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:40.255157 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:40.255598 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:40.389776 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:40.398092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-9f2acf5e-752b-4d06-9627-5c0aa604bf37 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.155556 Jun 21 18:45:40.398654 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 594/1174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:40 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:41.415131 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:41.415770 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:41.422238 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:41.422684 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:41.423436 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:41.423869 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:41.564830 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:41.572641 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-01785b53-9ec4-4165-ba9b-611cc7e348d3 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.161326 Jun 21 18:45:41.573214 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 581/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:41 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:42.285773 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [req-00d8245e-671a-40ca-ad8a-2b9f744b502b req-6d02845b-85c9-45f7-bfc0-0f3d2e08d9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2409585-7698-45dd-baf5-1bd79afc8664", "name": "network-vif-plugged", "status": "completed", "tag": "e616b4da-1d21-4139-8042-635e471c8b83"}]} {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:42.295419 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-00d8245e-671a-40ca-ad8a-2b9f744b502b req-6d02845b-85c9-45f7-bfc0-0f3d2e08d9b1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:42.295874 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [req-00d8245e-671a-40ca-ad8a-2b9f744b502b req-6d02845b-85c9-45f7-bfc0-0f3d2e08d9b1 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:42.307112 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.compute.server_external_events [req-00d8245e-671a-40ca-ad8a-2b9f744b502b req-6d02845b-85c9-45f7-bfc0-0f3d2e08d9b1 service nova] Creating event network-vif-plugged:e616b4da-1d21-4139-8042-635e471c8b83 for instance c2409585-7698-45dd-baf5-1bd79afc8664 on hv-cinder-83124 Jun 21 18:45:42.312505 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [req-00d8245e-671a-40ca-ad8a-2b9f744b502b req-6d02845b-85c9-45f7-bfc0-0f3d2e08d9b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030571 Jun 21 18:45:42.313134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 595/1176] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:45:42.588914 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:42.589465 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:42.596179 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:42.596612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:42.597555 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:42.597994 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:42.784966 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:42.792561 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-bc6b4ed9-1c99-45a4-b9c0-6e044f93129d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.207547 Jun 21 18:45:42.793134 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 582/1177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:42 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:43.811396 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:43.812092 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:43.819181 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:43.819622 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:43.820412 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:43.820891 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:43.957267 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:43.964880 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-94b4258d-7255-4380-ae19-ef6b5518b902 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1265 microversion: 2.1 time: 0.158266 Jun 21 18:45:43.965451 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 596/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:43 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:44.981076 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:44.981676 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:44.989068 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:44.993913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:44.993913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:44.993913 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:45.133590 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:45.141585 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-9b4caeff-ef2c-48d4-916b-8d757ca147d9 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1451 microversion: 2.1 time: 0.164428 Jun 21 18:45:45.142151 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 583/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:44 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:45.157749 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:45.158370 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:45.164979 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:45.165422 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:45.166182 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:45.166611 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:45.306769 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:45.314508 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-fcc8e75a-eb8f-470f-b9ba-d8d3f4f39aed tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1451 microversion: 2.1 time: 0.160712 Jun 21 18:45:45.315143 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 597/1180] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:45 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:47.291331 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2409585-7698-45dd-baf5-1bd79afc8664", "tag": "e616b4da-1d21-4139-8042-635e471c8b83"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:47.300208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:47.300679 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:47.312287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] Creating event network-changed:e616b4da-1d21-4139-8042-635e471c8b83 for instance c2409585-7698-45dd-baf5-1bd79afc8664 on hv-cinder-83124 Jun 21 18:45:47.317174 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR oslo.messaging._drivers.impl_rabbit [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] [f287af5a-10a8-4ad7-96e7-5e53dbc79b9c] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:45:48.324656 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] [f287af5a-10a8-4ad7-96e7-5e53dbc79b9c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37406. Jun 21 18:45:48.328500 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-ab7f81a4-5a95-441e-8c37-0deea17807bc req-d3a60c37-e833-4cea-a8a5-13a317588742 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041021 Jun 21 18:45:48.329138 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 584/1181] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:12.554820 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:46:12.555479 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:47:10.162734 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_api:SELECT=22 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:47:10.167340 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:47:10.168149 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG dbcounter [-] [118474] Writing DB stats nova_cell1:SELECT=46 {{(pid=118474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:47:10.172091 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:10.172679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:10.172806 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG dbcounter [-] [118472] Writing DB stats nova_cell1:SELECT=58 {{(pid=118472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:47:10.178804 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:10.180507 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:10.181582 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:10.182085 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:10.210785 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:47:10.243707 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-4dcf9c27-e93d-4d41-b5de-489842acb097 req-457374b6-37ec-49c4-b5d9-117fac494dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2409585-7698-45dd-baf5-1bd79afc8664", "tag": "e616b4da-1d21-4139-8042-635e471c8b83"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:47:10.252467 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-4dcf9c27-e93d-4d41-b5de-489842acb097 req-457374b6-37ec-49c4-b5d9-117fac494dda service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:10.255861 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-4dcf9c27-e93d-4d41-b5de-489842acb097 req-457374b6-37ec-49c4-b5d9-117fac494dda service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:10.265199 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-4dcf9c27-e93d-4d41-b5de-489842acb097 req-457374b6-37ec-49c4-b5d9-117fac494dda service nova] Creating event network-changed:e616b4da-1d21-4139-8042-635e471c8b83 for instance c2409585-7698-45dd-baf5-1bd79afc8664 on hv-cinder-83124 Jun 21 18:47:10.270518 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-4dcf9c27-e93d-4d41-b5de-489842acb097 req-457374b6-37ec-49c4-b5d9-117fac494dda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105783 Jun 21 18:47:10.271113 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 585/1182] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:47:10.522805 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-aeec4a83-a386-4819-a517-711d384cf7a0 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 204 len: 0 microversion: 2.1 time: 0.361494 Jun 21 18:47:10.523792 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 598/1183] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:47:10 2022] DELETE /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:47:10.533458 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:10.534168 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:10.541732 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:10.545156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:10.545156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:10.545156 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:10.676237 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:10.685170 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-399deed0-15ba-4e17-a739-5f15b1d1d374 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1576 microversion: 2.1 time: 0.156357 Jun 21 18:47:10.685767 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 586/1184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:10 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:11.703486 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:11.704197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:11.710962 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:11.711421 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:11.715360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:11.715360 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:11.850985 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:11.859430 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-132dd5a3-8bc6-4a99-889d-4384afbc0bc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1576 microversion: 2.1 time: 0.160227 Jun 21 18:47:11.860011 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 599/1185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:11 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:12.564699 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-825476fc-c1da-4953-a010-5023abfb2d8e req-b4fadb20-7e6f-40ab-95ff-417d61ade8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2409585-7698-45dd-baf5-1bd79afc8664", "name": "network-vif-deleted", "tag": "e616b4da-1d21-4139-8042-635e471c8b83"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:47:12.573546 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-825476fc-c1da-4953-a010-5023abfb2d8e req-b4fadb20-7e6f-40ab-95ff-417d61ade8cf service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:12.577670 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-825476fc-c1da-4953-a010-5023abfb2d8e req-b4fadb20-7e6f-40ab-95ff-417d61ade8cf service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:12.585098 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-825476fc-c1da-4953-a010-5023abfb2d8e req-b4fadb20-7e6f-40ab-95ff-417d61ade8cf service nova] Creating event network-vif-deleted:e616b4da-1d21-4139-8042-635e471c8b83 for instance c2409585-7698-45dd-baf5-1bd79afc8664 on hv-cinder-83124 Jun 21 18:47:12.590260 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-825476fc-c1da-4953-a010-5023abfb2d8e req-b4fadb20-7e6f-40ab-95ff-417d61ade8cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029129 Jun 21 18:47:12.590856 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 587/1186] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:47:12.878086 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:12.878933 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:12.887241 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:12.888090 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:12.888638 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:12.889155 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:12.954616 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:12.963439 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-40a1cac1-6ad5-48d5-a900-7b9cecf307c4 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 200 len: 1225 microversion: 2.1 time: 0.089175 Jun 21 18:47:12.964120 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:12 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:13.981501 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:13.982217 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: c2409585-7698-45dd-baf5-1bd79afc8664] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:13.988442 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:13.988905 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:13.989659 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:13.990099 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:14.003554 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] HTTP exception thrown: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Request method failure captured: Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 HTTP/1.1 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABishCqESBm8_LmvLjncM9CTIxXj39mKBpyD9Dy_pqJr4n2vxk3FL0pZn4NidkqAaeIVB6-K-_l1yJiAoJZObXSVRe2IlCpjfKwqOv7g-w8p8RzkaRE2ZiiFc9NU192SpALl_aam2yFdAB44e51zoIUc5lCtFlun8R-W_1KT-QQlSIw0H0 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:47:14.005208 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de887ac9630748ff80970b49454025fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de887ac9630748ff80970b49454025fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 35dc91771b734cf8a4da79fa4971548e Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. Jun 21 18:47:14.007035 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'c2409585-7698-45dd-baf5-1bd79afc8664'} Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:47:14.007971 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. Jun 21 18:47:14.010180 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:14.011542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Returning 404 to user: Instance c2409585-7698-45dd-baf5-1bd79afc8664 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:47:14.011542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-3e1ec063-d10d-43b4-8efe-2b816ccae822 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664" status: 404 len: 111 microversion: 2.1 time: 0.029864 Jun 21 18:47:14.011542 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 588/1188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:13 2022] GET /compute/v2.1/servers/c2409585-7698-45dd-baf5-1bd79afc8664 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:47:17.362680 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:47:17.363365 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:47:17.613066 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:17.613711 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:17.615232 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-f2f0b850-d868-48b1-9dc8-e805b7aec975 req-4151a65b-0638-4e9b-92c3-eaa52eba7d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e341de57-0877-44a7-8a94-84a7d0818e25", "tag": "522e98cb-e9d1-4288-92da-7810162ca2f0"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:47:17.621345 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:17.621703 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:17.622482 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:17.622927 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:17.625877 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-f2f0b850-d868-48b1-9dc8-e805b7aec975 req-4151a65b-0638-4e9b-92c3-eaa52eba7d07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:17.626336 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-f2f0b850-d868-48b1-9dc8-e805b7aec975 req-4151a65b-0638-4e9b-92c3-eaa52eba7d07 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:17.638381 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-f2f0b850-d868-48b1-9dc8-e805b7aec975 req-4151a65b-0638-4e9b-92c3-eaa52eba7d07 service nova] Creating event network-changed:522e98cb-e9d1-4288-92da-7810162ca2f0 for instance e341de57-0877-44a7-8a94-84a7d0818e25 on hv-cinder-83124 Jun 21 18:47:17.643979 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-f2f0b850-d868-48b1-9dc8-e805b7aec975 req-4151a65b-0638-4e9b-92c3-eaa52eba7d07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032487 Jun 21 18:47:17.648482 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 589/1189] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:47:17.654461 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Going to try to terminate instance {{(pid=118474) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:47:17.913326 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-a85c84ce-cddf-442c-98e2-043e9d2eb97b tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 204 len: 0 microversion: 2.1 time: 0.304219 Jun 21 18:47:17.914150 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 601/1190] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:47:17 2022] DELETE /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:47:17.923525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:17.924322 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:17.931489 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:17.932012 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:17.932888 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:17.933668 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:18.073488 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.policy [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:18.080960 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-32a76c16-dbbd-4a1b-956b-8984720d8f94 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1575 microversion: 2.1 time: 0.162202 Jun 21 18:47:18.081532 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 590/1191] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:17 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:19.099538 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:19.100252 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:19.106743 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:19.107197 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:19.107972 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:19.108433 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:19.244946 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:19.252509 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-c231270b-7e8b-4a8e-b667-ac19d08ad23d tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1575 microversion: 2.1 time: 0.157239 Jun 21 18:47:19.262882 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 602/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:19 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:19.866921 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [req-8439f950-9c56-4352-8620-c446d95b3d54 req-4838fbde-30ab-47a1-a2b9-f24be3929bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e341de57-0877-44a7-8a94-84a7d0818e25", "name": "network-vif-deleted", "tag": "522e98cb-e9d1-4288-92da-7810162ca2f0"}]} {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:47:19.877744 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8439f950-9c56-4352-8620-c446d95b3d54 req-4838fbde-30ab-47a1-a2b9-f24be3929bd7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:19.878344 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [req-8439f950-9c56-4352-8620-c446d95b3d54 req-4838fbde-30ab-47a1-a2b9-f24be3929bd7 service nova] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:19.890271 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.compute.server_external_events [req-8439f950-9c56-4352-8620-c446d95b3d54 req-4838fbde-30ab-47a1-a2b9-f24be3929bd7 service nova] Creating event network-vif-deleted:522e98cb-e9d1-4288-92da-7810162ca2f0 for instance e341de57-0877-44a7-8a94-84a7d0818e25 on hv-cinder-83124 Jun 21 18:47:19.895274 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [req-8439f950-9c56-4352-8620-c446d95b3d54 req-4838fbde-30ab-47a1-a2b9-f24be3929bd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Jun 21 18:47:19.895842 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 591/1193] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Jun 21 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:47:19.985220 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:47:19.985452 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:47:20.270913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:20.271679 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:20.279556 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:20.280140 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:20.281014 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:20.281522 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:20.343110 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.policy [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc91771b734cf8a4da79fa4971548e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de887ac9630748ff80970b49454025fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118474) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:47:20.350795 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-682dfc3e-fe10-4acd-9f3a-e772319dadc8 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 200 len: 1224 microversion: 2.1 time: 0.083938 Jun 21 18:47:20.355893 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 603/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:20 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:47:21.368957 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:21.369674 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: e341de57-0877-44a7-8a94-84a7d0818e25] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:21.376003 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.376487 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:21.377287 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.377714 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:21.391795 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] HTTP exception thrown: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Request method failure captured: Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 HTTP/1.1 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABishCqESBm8_LmvLjncM9CTIxXj39mKBpyD9Dy_pqJr4n2vxk3FL0pZn4NidkqAaeIVB6-K-_l1yJiAoJZObXSVRe2IlCpjfKwqOv7g-w8p8RzkaRE2ZiiFc9NU192SpALl_aam2yFdAB44e51zoIUc5lCtFlun8R-W_1KT-QQlSIw0H0 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:47:21.393407 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de887ac9630748ff80970b49454025fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de887ac9630748ff80970b49454025fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 35dc91771b734cf8a4da79fa4971548e Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. Jun 21 18:47:21.395139 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'e341de57-0877-44a7-8a94-84a7d0818e25'} Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:47:21.396069 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. Jun 21 18:47:21.397755 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.400359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Returning 404 to user: Instance e341de57-0877-44a7-8a94-84a7d0818e25 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:47:21.400359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-42f3f220-b420-4b97-aade-b0ae432f6889 tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25" status: 404 len: 111 microversion: 2.1 time: 0.030822 Jun 21 18:47:21.400359 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 592/1195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:21 2022] GET /compute/v2.1/servers/e341de57-0877-44a7-8a94-84a7d0818e25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:47:21.949956 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:21.950537 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.compute.api [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118474) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:21.957049 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.957502 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:21.958265 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.958712 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG oslo_concurrency.lockutils [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:21.972008 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.wsgi [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] HTTP exception thrown: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Request method failure captured: Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: request: DELETE /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 HTTP/1.1 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept: application/json Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Accept-Encoding: identity Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Connection: close Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Length: 0 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Content-Type: application/json Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Host: 10.222.0.23 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Openstack-System-Scope: None Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: User-Agent: python-urllib3/1.26.9 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Auth-Token: gAAAAABishCqESBm8_LmvLjncM9CTIxXj39mKBpyD9Dy_pqJr4n2vxk3FL0pZn4NidkqAaeIVB6-K-_l1yJiAoJZObXSVRe2IlCpjfKwqOv7g-w8p8RzkaRE2ZiiFc9NU192SpALl_aam2yFdAB44e51zoIUc5lCtFlun8R-W_1KT-QQlSIw0H0 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Id: None Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Domain-Name: None Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Identity-Status: Confirmed Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Is-Admin-Project: True Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Id: default Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Domain-Name: Default Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Project-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Role: member,reader Jun 21 18:47:21.973686 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Roles: member,reader Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de887ac9630748ff80970b49454025fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de887ac9630748ff80970b49454025fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-Tenant-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Id: default Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Domain-Name: Default Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Id: 35dc91771b734cf8a4da79fa4971548e Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: X-User-Name: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: method: > Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: exception: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:21.975473 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: action_args: {'id': 'ac10aa08-fb28-4f5c-afca-d4a1f5d9a219'} Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:47:21.976528 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:21.977913 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: ERROR nova.api.openstack.wsgi Jun 21 18:47:21.979373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Returning 404 to user: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. {{(pid=118474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:47:21.979373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-786ebaa5-3145-421e-9529-806d0fd6bdce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 404 len: 111 microversion: 2.1 time: 0.029699 Jun 21 18:47:21.979373 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 604/1196] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Jun 21 18:47:21 2022] DELETE /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:47:21.984201 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '>' {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:21.984852 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.compute.api [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] [instance: ac10aa08-fb28-4f5c-afca-d4a1f5d9a219] Fetching instance by UUID {{(pid=118472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:47:21.990885 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.991338 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:21.992096 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:47:21.993169 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG oslo_concurrency.lockutils [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Lock "770c3dab-ef8d-4f16-8479-2c2c8f1cce74" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:47:22.006144 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.wsgi [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] HTTP exception thrown: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Request method failure captured: Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: request: GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 HTTP/1.1 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept: application/json Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Accept-Encoding: identity Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Connection: close Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Length: 0 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Content-Type: application/json Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Host: 10.222.0.23 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Openstack-System-Scope: None Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: User-Agent: python-urllib3/1.26.9 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Auth-Token: gAAAAABishCqESBm8_LmvLjncM9CTIxXj39mKBpyD9Dy_pqJr4n2vxk3FL0pZn4NidkqAaeIVB6-K-_l1yJiAoJZObXSVRe2IlCpjfKwqOv7g-w8p8RzkaRE2ZiiFc9NU192SpALl_aam2yFdAB44e51zoIUc5lCtFlun8R-W_1KT-QQlSIw0H0 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Id: None Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Domain-Name: None Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Identity-Status: Confirmed Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Is-Admin-Project: True Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Id: default Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Domain-Name: Default Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Project-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Role: member,reader Jun 21 18:47:22.007635 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Roles: member,reader Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de887ac9630748ff80970b49454025fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de887ac9630748ff80970b49454025fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de887ac9630748ff80970b49454025fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Id: de887ac9630748ff80970b49454025fd Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1158530144 Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Id: default Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Domain-Name: Default Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Id: 35dc91771b734cf8a4da79fa4971548e Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: X-User-Name: tempest-TestVolumeBootPattern-1158530144-project Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: method: > Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: exception: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:22.010123 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: action_args: {'id': 'ac10aa08-fb28-4f5c-afca-d4a1f5d9a219'} Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: {{(pid=118472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:47:22.011286 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. Jun 21 18:47:22.013050 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: ERROR nova.api.openstack.wsgi Jun 21 18:47:22.014525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: DEBUG nova.api.openstack.wsgi [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Returning 404 to user: Instance ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 could not be found. {{(pid=118472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:47:22.014525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO nova.api.openstack.requestlog [None req-8794dcce-a9f9-4c7b-81e6-da7818040cce tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219" status: 404 len: 111 microversion: 2.1 time: 0.029402 Jun 21 18:47:22.014525 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: [pid: 118472|app: 0|req: 593/1197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Jun 21 18:47:21 2022] GET /compute/v2.1/servers/ac10aa08-fb28-4f5c-afca-d4a1f5d9a219 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:47:23.455361 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: DEBUG nova.api.openstack.wsgi [None req-5c73aa59-301a-4a22-84e9-79d80234925f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] Calling method '.version_select at 0x7fd39c06f820>' {{(pid=118474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:47:23.531926 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO nova.api.openstack.requestlog [None req-5c73aa59-301a-4a22-84e9-79d80234925f tempest-TestVolumeBootPattern-1158530144 tempest-TestVolumeBootPattern-1158530144-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710883758" status: 202 len: 0 microversion: 2.1 time: 0.080402 Jun 21 18:47:23.532462 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: [pid: 118474|app: 0|req: 605/1198] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Jun 21 18:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710883758 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:47:27.979276 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:47:27.979889 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:50:37.372735 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:50:37.373446 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:50:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:50:39.994134 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:50:39.994644 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:50:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:50:47.988072 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:50:47.988612 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:52:34.948619 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:52:34.949312 dv-cinder-831247-19-iscsi devstack@n-api.service[118472]: Tue Jun 21 18:52:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:52:43.475324 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:52:43.475922 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:52:52.566897 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:52:52.567565 dv-cinder-831247-19-iscsi devstack@n-api.service[118474]: Tue Jun 21 18:52:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!